DevOps on AWS Radio: Big Data – Robert Murphy (Episode 15)

In this episode, Paul Duvall and Brian Jakovich cover recent DevOps on AWS news along with a discussion with Robert Murphy, who is a Senior DevOps Automation Engineer at Stelligent.

Here are the show notes:

DevOps on AWS News

• Validating AWS CloudFormation templates with cfn_nag and mu
• Serverless CloudFormation Linting in AWS CodePipeline
• Custom rule development for cfn_nag
• Protecting your API using Amazon API Gateway and AWS WAF — Part I
• AWS CodeBuild Adds Support for Windows Builds
• Use Slack ChatOps to Deploy Your Code – How to Integrate Your Pipeline in AWS CodePipeline with Your Slack Channel
• CloudFormation Support for AWS Service Catalog
• AWS Case Study with Stelligent’s Customer: Washington Post
• AWS Case Study with Stelligent’s Customer: 3M HIS

Episode Topics

1. Description of Big Data
2. AWS resource considerations for Big Data
3. Incorporating CI/CD into software systems using Big Data and Machine Learning
4. Reducing deployment lead time from 30 hours to 34 minutes
5. Description of different deployment pipelines: AMI provisioning, model training, and microservices
6. Deployment pattern usage
7. Using Twistlock Defender
8. How they reduced deployment lead times to 34 minutes
9. Lessons learned with CI/CD for Big Data and Machine Learning

About DevOps on AWS Radio

On DevOps on AWS Radio, we cover topics around applying DevOps principles and practices such as Continuous Delivery on the Amazon Web Services cloud. This is what we do at Stelligent for our customers. We’ll bring listeners into our roundtables and speak with engineers who’ve recently published on our blog and we’ll also be reaching out to the wider DevOps on AWS community to get their thoughts and insights.
The overall vision of this podcast is to describe how listeners can create a one-click (or “no click”) implementation of their software systems and infrastructure in the Amazon Web Services cloud so that teams can deliver software to users whenever there’s a business need to do so. The podcast will delve into the cultural, process, tooling, and organizational changes that can make this possible including:

• Automation of
  • Networks (e.g. VPC)
  • Compute (EC2, Containers, Serverless, etc.)
  • Storage (e.g. S3, EBS, etc.)
  • Database and Data (RDS, DynamoDB, etc.)
• Organizational and Team Structures and Practices
• Team and Organization Communication and Collaboration
• Cultural Indicators
• Version control systems and processes
• Deployment Pipelines
  • Orchestration of software delivery workflows
  • Execution of these workflows
• Application/service Architectures – e.g. Microservices
• Automation of Build and deployment processes
• Automation of testing and other verification approaches, tools and systems
• Automation of security practices and approaches
• Continuous Feedback systems
• Many other Topics…

Stelligent Amazon Pollycast