Current Cloud Trends from AWS re:Invent 2015
Our guest on the podcast this week is Mike Draper, Vice President, Principal Architect at Cloud Technology Partners. We discuss 2015 cloud trends and news from this year’s AWS re:Invent. With topics from big data, application migration, security, and internet of things, there is no shortage of new products and services available in the industry. The most notable announcements so far have been the release of AWS Database Migration Service and Snowball, a 50TB shippable data storage appliance.
Subscribe: iTunes FeedBurner
HIGHLIGHTS FROM DAY 2 KEYNOTE
UPDATE: IoT and the cloud are hot together.
At the keynote Thursday morning, AWS announced the release of AWS IoT, along with many other new services. AWS IoT provides the infrastructure that allows connected devices to easily and securely interact with cloud services and with other devices, all at world-scale.
Indeed, besides big data, IoT could be the biggest killer application for cloud this year and perhaps the largest killer application for the cloud in 2016.
Don’t let the large number of startups’ IoT offerings and big companies’ IoT investments fool you: It’s still very early days. The IoT trend today is where cloud computing was in 2003, and it will follow the same maturation model.
If there’s a difference, it is that IoT leverages — and even requires — the cloud. The reason the cloud and IoT are so hot together is that they benefit from one another. IoT needs elastic resources, and the cloud provides those in three key areas.
First, an IoT service may have to support 1,000KB of data some days and 3TB of data on other days. Sensor data comes when it comes, and the back-end system must accommodate the absorption of data; otherwise, the whole thing falls down.
Second, an IoT service has to communicate with back-end systems that are geographically distributed. Public cloud systems are the perfect infrastructure for this because they let use a close point of presence, and you don’t have to send sensor data yourself across the ocean.
Third, the cloud offers built-in security that’s pretty good. You’re much better off using the security services in a public cloud like AWS than you are building the security yourself. This means the IoT service can assume the data is protected and any compliance issues are taken care of.
UPDATE: Werner Vogels announces additional AWS features at Thursday morning’s Keynote.
“Over 500 new features and services this year.” – Werner Vogels
- Amazon Kinesis Analytics is the easiest way to run standard SQL queries against streaming data.
- The EC2 Instance Update- XI will feature up to 2 TB of memory, a full order of magnitude larger than the current generation of high-memory instances. These instances are designed for demanding enterprise workloads including production installations of SAP HANA, Microsoft SQL Server, Apache Spark, and Presto.
- The EC2 Instance Update- T2 Nano provides a baseline level of processing power, along with the ability to save up unused cycles (“CPU Credits”) and use them when the need arises.
- EC2 Container Service Update – Amazon EC2 Container Registry makes it easy for you to store, manage, distribute, and collaborate around Docker container images.
- EC2 Container Service Update – Amazon EC2 Container Service CLI is a command line interface for Amazon EC2 Container Service (ECS) that provides high level commands that simplify creating, updating and monitoring clusters and tasks from a local development environment.
- CloudWatch Dashboards monitor your AWS cloud resources and your cloud-powered applications. It tracks the metrics so that you can visualize and review them.
- The AWS Lambda Update has a new set of features that include VPC support, python functions, increased function duration, function versioning and scheduled functions.
- AWS IoT provides the infrastructure that allows connected devices to easily and securely interact with cloud services and with other devices, all at world-scale.
- AWS Mobile Hub (Beta) simplifies the process of building, testing, and monitoring mobile applications that make use of one or more AWS services.
HIGHLIGHTS FROM DAY 1 KEYNOTE
UPDATE: Andy Jassy reveals new AWS services and tools.
- Amazon QuickSight is a fast, cloud-powered business intelligence (BI) service that makes it easy to build visualizations, perform ad-hoc analysis, and quickly get business insights from data. Amazon QuickSight integrates with AWS data stores, flat files, and third-party sources, and it remains super-fast and responsive while seamlessly scaling to hundreds of thousands of users and petabytes of data.
- Amazon Kinesis Firehose Amazon Kinesis Firehose is the easiest way to load streaming data into AWS. It can capture and automatically load streaming data into Amazon S3 and Amazon Redshift, enabling near real-time analytics with existing business intelligence tools you’re already using today. It is a fully managed service that requires no ongoing administration.
- AWS Snowball uses secure appliances to help accelerate petabyte-scale data transfers into and out of AWS. Using Snowball addresses common challenges with large-scale data transfers including high network costs, long transfer times, and security concerns. Transferring data with Snowball is simple, fast, secure, and can be as little as one-fifth the cost of high-speed Internet.
- Amazon’s RDS Update- MariaDB is now available as a fully-managed service on AWS with up to 6TB of storage, 30,000 IOPS, and support for high-availability deployments through the Amazon Relational Database Service. Amazon RDS for MariaDB is available in all commercial regions. You can start running production workloads from day one with high availability using multiple availability zones.
- AWS Database Migration Services helps you migrate databases to AWS easily and securely with minimal downtime. It supports all widely used database platforms, and performs schema and code conversion for migrations between database engines. AWS Database Migration Service is low cost and simple to use. You only pay for the compute resources used during the migration process and can typically migrate a terabyte-size database for as little as three dollars.
- New AWS Config Rules is a new set of cloud governance capabilities that allow IT administrators to define guidelines for provisioning and configuring AWS resources and then continuously monitor compliance with those guidelines. AWS Config Rules ensures EBS volumes are encrypted, EC2 instances are properly tagged, and Elastic IP addresses (EIPs) are attached to instances.
- Amazon Inspector is an automated security assessment service that helps minimize the likelihood of introducing security or compliance issues when deploying applications on AWS. Amazon Inspector automatically assesses applications for vulnerabilities or deviations from best practices. After performing an assessment, Amazon Inspector produces a detailed report with prioritized steps for remediation.
- Amazon Elasticsearch Service is a managed service that makes it easy to deploy, operate, and scale Elasticsearch in the AWS Cloud. Elasticsearch is a popular open-source search and analytics engine for use cases such as log analytics, real-time application monitoring, and clickstream analytics. You can get started with Amazon Elasticsearch Service as part of the AWS Free Tier.
- AWS WAF is a web application firewall that helps to protect web applications from attack by blocking common web exploits like SQL injection and cross-site scripting. AWS WAF integrates seamlessly with Amazon CloudFront, our global content delivery network, and includes an API that you can use to automate the creation, deployment, and maintenance of web security rules.
- An Amazon EC2 Dedicated Host is a physical server with EC2 instance capacity fully dedicated to your use. Dedicated Hosts can help you address compliance requirements and reduce costs by allowing you to use your existing server-bound software licenses.
UPDATE: Live from the first Keynote at re:Invent with Andy Jassy, Jim Fowler and Rob Alexander.
HIGHLIGHTS FROM THE GLOBAL PARTNER SUMMIT
UPDATE: AWS has just announced their 2016 Premier Consulting Partners at the Global Partner Keynote. Cloud Technology Partners is among the newly named partners.
UPDATE: Terry Wise, VP of Channels & Alliances at AWS, kicks off the Partner Keynote
Miss last year’s show? Here’s our recap.
2014 Keynotes and Presentations
2014 Key Takeaways
- re:Invent is massive, by far the largest cloud event of the year with over 13,500 attendees plus thousands more watching online. Cloud Technology Partners was a gold sponsor and had 500+ people stop by our booth and talk with Dr. Freud about their cloud problems.
- AWS is on track to deploy over 500 product updates in 2014 and still dominates the cloud market, well ahead of Azure and Google Cloud Platform.
- A report from Synergy Research Group places Amazon’s share of the cloud infrastructure services market at 27%. Microsoft is second at 10%
- AWS’s services as a whole are growing at a rate of 40% this year compared to last; EC2 virtual machine use is up 99% this year compared to 2013; while S3 storage is up 137% compared to last year.
- Amazon has passed the 1 million mark for active accounts, defined as a customer who uses AWS resources at least once a month.
What a show! 2014 Podcast Debrief
Our guest on the podcast this week is Kacy Clarke, Vice President and Principal Cloud Architect here at CTP. We discuss new services and capabilities announced at this year’s AWS re:Invent conference. While beneficial to customers, many of Amazon’s new services overlap with partners, creating understandable anxiety amongst the APN. Listen in to learn about the new announcements, and what they mean for all of us.
2014 Product Announcements
- AWS Aurora – is a MySQL-compatible database engine for Amazon Relational Database Service (RDS). AWS says it combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. 11 nines of durability. Six copies of data in the region, up to 15 read replicas. Aurora can process 6 million inserts to its database per minute, and 30 million selects per minute. AWS says that’s five times faster than using MySQL on its EC2 VMs.
- AWS Key Management Service – it uses the Hardware Security Module, a box that sits on customers’ premises, and works with all the other AWS services. It provides centralized control of encryption including new key creation and rotation, usage policies, and logging from the AWS Management Console, or by using the API.
- AWS Config – Last year AWS announced CloudTrail, a service that lets users get a list of all the actions that have happened in a user’s account. This year AWS introduced AWS Config, a sort of next generation version of that offering that provides customers with full visibility into their AWS resources and associated relationships, lets them audit resource configuration history, and notifies them of resource configuration changes. You have to feel sorry for vendors like Cloudyn, Cloudability, CloudHealth, and Cloud Checkr who have been building a business on providing manageability for AWS deployments.
- AWS Service Catalog – finally, an easy way to provide a portal to development teams that gives them self service provisioning without giving them access to everything.
- Three CI/CD tools – CodeCommit (Git like code repository), CodeDeploy, CodePipeline – These tools can provide rolling updates across an application set and are based on the Apollo toolset long used by Amazon. They work with open source tools such as GitHub, CircleCI, Atlassian, Codeship, Solano CI, and CloudBees (Jenkins continuous integration).
- EC2 Container Service – Docker container scheduling and management. Why can’t AWS just support Kubernetes?
- AWS Lambda – platform for event handling. Using AWS Lambda, code runs in response to an event, such as a file uploading to an S3 bucket, a change in a DynamoDB stream, or a custom event in an application.
- Larger EBS Volumes – Larger and faster elastic block store (EBS) volumes up to 16 TB
- New EC2 Instance type – Based on new hardware from Intel, C4 is a new compute-optimized virtual machine instance type that includes new 2.9 GHz Intel Xeon E5-2666 v3 (Haswell) processors. They run up to 36 virtual CPUs and are optimized to be used with AWS EBS (Elastic Block Storage).