Managed Kubernetes in Public Cloud
- Introduction
- Terraform Kubernetes Boilerplates
- GKE vs EKS vs AKS
- Other Managed Kubernetes
- AWS EKS (Hosted/Managed Kubernetes on AWS)
- AKS Azure Kubernetes Service
- GKE Google Kubernetes Engine
- IKS IBM Cloud Kubernetes Service
- Linode Kubernetes Engine LKE
- DOKS Digital Ocean Kubernetes
- Oracle Cloud Kubernetes
- Provisioning cloud resources (AWS, GCP, Azure) in Kubernetes
- Kubesphere
- Giant Swarm
- Tools for multi-cloud Kubernetes management
- Videos
- Tweets
Introduction
- infoworld.com: 6 reasons to switch to managed Kubernetes Managed Kubernetes services have matured to the point where many enterprises are handing over the keys to their clusters. Here we identify some of the main drivers behind that trend.
- Allocatable memory and CPU in Kubernetes Nodes π Not all CPU and memory in your Kubernetes nodes can be used to run Pods. In this article, you will learn how managed Kubernetes Services such AKS, EKS and GKE reserve resources for workloads, operating systems, daemons and Kubernetes agent.
- armosec.io: Which Managed Kubernetes Is Right for Me? This blog will compare on-premises, or self-hosted,Kubernetes clusters to managed ones, as well as outline your options for Kubernetes in the cloud
- infoworld.com: CNCF survey: Managed Kubernetes becomes the norm Cloud Native Computing Foundationβs latest survey shows that container and Kubernetes usage continues to rise, as managed services ease the operational burden on their teams.
Terraform Kubernetes Boilerplates
GKE vs EKS vs AKS
- medium.com: Kubernetes Cloud Services: Comparing GKE, EKS and AKS
- stackrox.com: EKS vs GKE vs AKS - Evaluating Kubernetes in the Cloud
- youtube: Kubernetes Comparison A beautiful comparison of Kubernetes Services from GCP, AWS and Azure by learnk8s.
- medium: State of Managed Kubernetes 2020 EKS vs. AKS vs. GKE from a Developerβs Perspective
- medium: Managed Kubernetes Services Compared: GKE vs. EKS vs. AKS Comparing the three most popular managed Kubernetes platforms in features and overall experience.
- acloudguru.com: AKS vs EKS vs GKE: Managed Kubernetes services compared
Other Managed Kubernetes
- thenewstack.io: Otomi Container Platform Offers an Integrated Kubernetes Bundle If you want to enjoy the benefits of Kubernetes, configuring and installing the software itself can be just the first of many deeply technical and oftentimes confusing steps. To simplify this, many major cloud providers offer managed Kubernetes services, but even then you may need to install secondary services to handle tasks such as tracing, logging, monitoring, identity access management, and so on. The Otomi Container Platform looks to address this complexity by bundling together more than 30 different Kubernetes add-ons, as well as providing what it calls an βOSX like interface,β and today the project has open sourced a community edition under the Apache 2.0 license.
- otomi.io π
- github: Otomi GitOps powered K8s app suite with developer self-service
AWS EKS (Hosted/Managed Kubernetes on AWS)
- dzone: kops vs EKS
- udemy.com: amazon eks starter kubernetes on aws
- eksctl: EKS installer
- medium: Implementing Kubernetes Cluster using AWS EKS (AWS Managed Kubernetes)
- Amazon EKS Security Best Practices
- thenewstack.io: Install and Configure OpenEBS on Amazon Elastic Kubernetes Service
- cloudonaut.io: Scaling Container Clusters on AWS: ECS and EKS π
- magalix.com: Deploying Kubernetes Cluster With EKS π Fargate Deployment vs. Linux Workload
- Deploying Infrastructure (FrontEnd + BackEnd) on AWS using Amazon EKS
- EKS Service Accounts Explained In AWS you can assign IAM permissions to pods in your cluster. This article explains how it works.
- medium: Building the CI/CD of the Future, Creating the EKS Cluster π
- Announcing the AWS Controllers for Kubernetes Preview
- daveops.xyz: Administrar usuarios en EKS
- aws.github.io: AWS Controllers for Kubernetes
- stacksimplify.com: AWS ALB Ingress Service - Basics π
- Kubernetes PVCs with EFS provisioner
- Using Helm with Amazon EKS without kubeconfigs
- Running spot instances effectively with Amazon EKS
- medium: Designing a Kubernetes Cluster with Amazon EKS From Scratch π
- en.sokube.ch: AWS + Kubernetes = AWS Elastic Kubernetes Service (EKS) π
- aws.amazon.com: Operating a multi-regional stateless application using Amazon EKS
- clickittech.com: Amazon ECS vs EKS : The Best Container Orchestration Platform π
- POKE - Provision Opinionated Kubernetes on EKS Poke is infrastructure as software to provision EKS cluster in an opinianated way. Code is written in nodejs utilising pulumi framework. It is opinionated in such a way to improve security and simplicity.Consider this similar to terraform module. This package can be used to provision eks clusters declaratively with immutability and repeatability.
- clickittech.com: Kubernetes Multi tenancy with Amazon EKS: Best practices and considerations
- automateinfra.com: Getting Started with Amazon Elastic kubernetes Service (AWS EKS)
- medium: Run Kubernetes Production Environment on EC2 Spot Instances With Zero Downtime: A Complete Guide
- releaseops.io: Scaling Kubernetes Deployments in AWS with Container Insights Metrics
- medium: Create Kubernetes Cluster On AWS EKS Setup AWS credentials and install kubectl, eksctl on Ubuntu. Create Kubernetes cluster using eksctl.
- Amazon EKS Price Reduction
- cloudonaut.io: Scaling Container Clusters on AWS: ECS and EKS π
- Amazon EKS Best Practices Guide for Security π
- info.acloud.guru: Scaling the hottest app in tech on AWS and Kubernetes
- itnext.io: Using AWS NLB manually targeting an EKS Service exposing UDP traffic
- Amazon EKS Now Supports EC2 Inf1 Instances
- Create a pipeline with canary deployments for Amazon EKS with AWS App Mesh π
- medium: Using Helm with Amazon EKS without kubeconfigs
- linkedin.com: Amazon EKS Distro (EKS-D): The Kubernetes Distribution Used by Amazon EKS π
- aws.amazon.com: Introducing Federated Amazon EKS Clusters on AWS
- medium: How to Deploy an EKS stack in AWS?
- aws.amazon.com: Fluent Bit Integration in CloudWatch Container Insights for EKS
- Optimizing Your Kubernetes Clusters with Rancher and Amazon EKS π
- clickittech.com: Amazon ECS vs EKS : The Best Container Orchestration Platform π
- faun.pub: Upgrading and Scaling Kubernetes cluster in AWS
- youtube/StackSimplify: Kubernetes Deployments on AWS EKS | Amazon Elastic Kubernetes Service | Amazon EKS π
- cloudify.co: Simplifying Hybrid Cloud Deployments With AWS EKS And Outpost
- eksworkshop.com π
- cast.ai: AWS EKS vs. ECS vs. Fargate: Where to manage your Kubernetes?
- cast.ai: 8 best practices to reduce your AWS bill for Kubernetes
- aws whitepapers: Architecting Amazon EKS for PCI DSS Compliance (pdf) ππ
- github.com/aws/eks-charts π
- AWS Load Balancer Controller π
- Updating a managed node group amazon eks managed node groups now supports parallel node upgrades
- particule.io: Create Kubernetes federated clusters on AWS
- aws.github.io/aws-eks-best-practices π
- betterprogramming.pub: Amazon EKS Is Eating My IPs! Understand how AWS EKS manages IP addresses and what you can do about it
- engineering.salesforce.com: Optimizing EKS networking for scale
- blog.usejournal.com: Spice up Your Kubernetes Environment with AWS Lambda π In this blog you will learn a simple yet effective and secure way to integrate AWS Lambda with an existing Kubernetes environment without codes changes.
- azon EKS Pod Identity Webhook Amazon EKS Pod Identity Webhook
- Chaos engineering on Amazon EKS using AWS Fault Injection Simulator
- pages.awscloud.com: GitOps on AWS for High Performing Team Operations (eBook) Realize the full value of Kubernetes by leveraging GitOps to manage operational complexity
- thenewstack.io: Deploy Gremlin to Amazon EKS Using AWS CloudFormation
- aws.amazon.com: Easy as one-two-three policy management with Kyverno on Amazon EKS π
- nextlinklabs.com: Handling Auth in EKS Clusters: Setting Up Kubernetes User Access Using AWS IAM
- neal-davis.medium.com: ECS vs EC2 vs Lambda π
- faun.pub: Kubernetes Multi-tenancy with Amazon EKS: Best practices and considerations π
- nginx.com: Deploying NGINX Ingress Controller on Amazon EKS: How We Tested
- hackerxone.com: 13 Steps Guide to Create Kubernetes Cluster on AWS
- hackerxone.com: Steps to Create Amazon EKS node group on Amazon web Service (AWS)
- dev.to: EKS IAM Deep Dive π
- aws.plainenglish.io: 6 Tips to Improve Availability with AWS Load Balancers and Kubernetes
- aws.amazon.com: Using Prometheus Adapter to autoscale applications running on Amazon EKS
- youtube: CloudGeeks - Terraform Eks Kubernetes RDS Secrets Manager Eksctl Cloudformation ALB Controller (Redmine App) - quickbooks2018/eks-redmin
- aws.amazon.com: Kubernetes Ingress with AWS ALB Ingress Controller
- automateinfra.com: The Ultimate Guide on AWS EKS for Beginners (Easiest Way)
- aws/aws-node-termination-handler π Gracefully handle EC2 instance shutdown within Kubernetes
- howtoforge.com: How to Create a Kubernetes Cluster with AWS CLI
- blog.searce.com: Optimise cost for AWS EKS cluster using Spotinst π
- thenewstack.io: How We Built Preview Environments on Kubernetes and AWS
- aws.amazon.com: Mount Amazon EFS file systems cross-account from Amazon EKS, and utilize AWS Organizations more effectively
- Onfidoβs Journey to a Multi-Cluster Amazon EKS Architecture In this article, you will learn how moving to an active/active cluster architecture has allowed Onfido to shift traffic away from an Amazon EKS cluster when performing infrastructure maintenance.
- medium.com/@abhinav.ittekot: Granting IAM permissions to pods in EKS using OIDC
- medium.com/@ishana98dadhich: Integrating AWS Secret Manager with EKS and use Secrets inside the Pods: Part-1 This blog provides you enough details on how you can use secrets (managed by AWS Secrets Manager) inside AWS EKS pods.
- aws.amazon.com: Planning Kubernetes Upgrades with Amazon EKS
- medium.com/@radha.sable25: Enabling IAM users/roles Access on Amazon EKS cluster
- aws.amazon.com: Continuous Delivery of Amazon EKS Clusters Using AWS CDK and CDK Pipelines
EKS and IaC with Crossplane
- aws.amazon.com: GitOps model for provisioning and bootstrapping Amazon EKS clusters using Crossplane and Argo CD
- nivogt.medium.com: [IaC] Continuous Delivery with Crossplane and ArgoCD : how to automate the creation of AWS EKS clusters
AWS EKS Vs ECS Vs Fargate
EKS Anywhere (on premises)
- EKS Anywhere: github.com/aws/eks-anywhere Run Amazon EKS on your own infrastructure
- aws.amazon.com: Amazon EKS Anywhere β Now Generally Available to Create and Manage Kubernetes Clusters on Premises
- solo.io: Connect Your Services Seamlessly with Amazon EKS Anywhere and Istio
- anywhere.eks.amazonaws.com: Compare EKS Anywhere and EKS
- aws.amazon.com: Getting started with Amazon EKS Anywhere
- gokulchandrapr.medium.com: Amazon EKS Anywhere & EKS Connector
EKS Distro (EKS-D)
- aws/eks-distro Amazon EKS Distro (EKS-D) is a Kubernetes distribution based on and used by Amazon Elastic Kubernetes Service (EKS) to create reliable and secure Kubernetes clusters.
Testing Kubernetes Canary deployment on EKS
AKS Azure Kubernetes Service
- docs.microsoft.com: Microservices architecture on Azure Kubernetes Service (AKS) π This reference architecture shows a microservices application deployed to Azure Kubernetes Service (AKS). It describes a basic AKS configuration that can be the starting point for most deployments. The architecture consists of the following components:
- Azure Kubernetes Service (AKS)
- Kubernetes cluster
- Virtual network
- Ingress
- Azure Load Balancer
- External data stores
- Azure Active Directory
- Azure Container Registry
- Azure Pipelines
- Helm
- Azure Monitor
- docs.microsoft.com: Use kubenet networking with your own IP address ranges in Azure Kubernetes Service (AKS) π
- docs.microsoft.com: Configure Azure CNI networking in Azure Kubernetes Service (AKS)
- trstringer.com: Run Kubernetes Pods on Specific VM Types in AKS
- docs.microsoft.com: AKS-managed Azure Active Directory integration
- stacksimplify.com/azure-aks: Kubernetes On Cloud Roadmap
- build5nines.com: Terraform: Create an AKS Cluster π
- github.com: AKS: Use AAD identity for pods and make your SecOps happy
- docs.microsoft.com: Microservices architecture on Azure Kubernetes Service (AKS) π
- techcommunity.microsoft.com: Containerize and migrate applications to AKS with the Azure Migrateβs new App Containerization tool
- mehmetozkaya.medium.com: Deploying .Net Microservices to Azure Kubernetes Services(AKS) and Automating with Azure DevOps
- faun.pub: How to implement Azure Kubernetes Service (AKS) in Cloud?
- adamrushuk.github.io: Increasing the volumeClaimTemplates Disk Size in a Statefulset on AKS
- nillsf.com: Running Windows containers on the Azure Kubernetes Service (AKS)
- itnext.io: Running Your Microservices Securely on AKS
- docs.microsoft.com: Create an HTTPS ingress controller on Azure Kubernetes Service (AKS)
- blog.nillsf.com: Customize core dump in Azure Kubernetes
- medium: Secure your Microservices on AKS β Part 1 π
- zartis.com: How To Save A Fortune On Azure Kubernetes Service
- itnext.io: AKS Performance: Limit Ranges Limit Ranges can be used to fine tune your resource consumption by limiting your min/max requests/limits in namespaces.
- devoteam.com: Azure Kubernetes Service (AKS) with Azure DevOps
- itnext.io: Kubernetes Ingress on Azure using the Application Gateway How to expose multiple services on a single host
- joachim8675309.medium.com: AKS with GRPC and ingress-nginx Using GRPC with ingress-nginx add-on with AKS
- thenewstack.io: Microsoftβs Practical Approach to Kubernetes Management
- medium: AKS with Calico Network Policies Using Calico Network Policy with Azure Kubernetes Server
- itnext.io: Network Isolated AKS β Part 1: Controlling network traffic
- thenewstack.io: Turbocharging AKS Networking with Calico eBPF
- carlos.mendible.com: AKS: Persistent Volume Claim with an Azure File Storage protected with a Private Endpoint
- joachim8675309.medium.com: AKS with Istio Service Mesh Securing traffic with Istio service mesh on AKS
- optisolbusiness.com: Implementing Microservices Architecture in AKS
- blog.kasten.io: AKS and Storage: How to Design Storage for Cloud Native Applications
- blog.kasten.io: AKS and Storage: Performance Differences Among K8s Storage Services
- medium: AKS β different load balancing options. When to use what?
- medium: Going multicloud with kubernetes and Azure Front Door Kubernetes/AKS/GKE/MultiCloud/Azure Front Door
- docs.microsoft.com: Best practices for cluster isolation in Azure Kubernetes Service (AKS)
- docs.cloudblue.com: Deploying an AKS Cluster with Custom IP Ranges (ARM template)
- k21academy.com: Azure Kubernetes Service & Azure Container Instances For Beginners π
- azurecloudai.blog: Deploy Azure Kubernetes Service (AKS) to a preexisting VNET
- tigera.io: Turbocharging AKS networking with Calico eBPF
- akhilsharma.work: How to list Azure RBAC Roles to Secure AKS Clusters
- tigera.io: Calico WireGuard support with Azure CNI Last June, Tigera announced a first for Kubernetes: supporting open-source WireGuard for encrypting data in transit within your cluster. We never like to sit still, so we have been working hard on some exciting new features for this technology, the first of which is support for WireGuard on AKS using the Azure CNI.
- docs.microsoft.com: Use dual-stack (IPv4 and IPv6) kubenet networking in Azure Kubernetes Service (AKS) (Preview)
- logz.io: Collecting Metrics from Windows Kubernetes Nodes in AKS π
- dev.to: Moving Azure Functions from AKS to Container Apps
- techcommunity.microsoft.com: Azure Kubernetes Service and Azure Container Registry Service on Azure Stack Hub
- dev.to: Getting started with Windows Containers on Azure Kubernetes Service Windows support has finally arrived in Kubernetes and AKS. Learn how to migrate your workloads and what pitfalls to avoid in this short and sweet introduction to Windows Containers.
- mehighlow.medium.com: Hardened-AKS/Secrets Commonly, an application requires access to data and, usually, such access must be restricted. So, you need to provide your pod/deployment/replicaSet/DaemonSet with secrets. Learn how you can do so in AKS
- returngis.net: Desescalar nodos de AKS apagando las mΓ‘quinas en lugar de eliminarlas
- dev.to/javiermarasco: HTTPs with Ingress controller, cert-manager and DuckDNS (in AKS/Kubernetes)
- dev.to: Implement Azure AD Workload Identity on AKS with terraform Azure AD workload identity is designed to associate a pod with an identity in Azure Active Directory so that you can grant permissions to access another resource (i.e. a storage account or an Azure SQL Database)
GKE Google Kubernetes Engine
- Google Kubernetes Engine
- One of the most helpful GKE features is the ability to create clusters and node pools with custom kernel parameters. This means you no longer need to use one-off daemonsets, or random workarounds, to tune your machines after cluster creation.
- Fetches all Primitive and Predefined GCP IAM Roles
- Using new traffic control features in External HTTP(S) load balancer
- Setting up NodeLocal DNSCache
- Looking ahead as GKE, the original managed Kubernetes, turns 5
- blog.doit-intl.com: How to Set Up Multi-Cluster Load Balancing with GKE
- codeburst.io: Google Kubernetes Engine Logging by Example
- cloud.google.com: Discover and invoke services across clusters with GKE multi-cluster services
- Introducing GKE Autopilot: a revolution in managed Kubernetes π
- techcrunch.com: Google Cloud puts its Kubernetes Engine on autopilot
- zdnet.com: Google introduces GKE Autopilot for hands-off Kubernetes The new GKE Autopilot, generally available now, steps up the level of automation involved in Kubernetes management, down to eliminating all node management.
- thenewstack.io: Googleβs New βAutopilotβ for Kubernetes
- cloud.google.com: GKE Autopilot π
- medium: How to provision Kubernetes Cluster in GCP Cloud (K8s)? π
- youtube: GKE Autopilot - Fully Managed Kubernetes Service From Google π
- insights.project-a.com: Using GitHub Actions to deploy to Kubernetes in GKE π
- faun.pub: How to automate the setup of a Kubernetes cluster on GCP Using Ansible to install, setup, and configure a Google Kubernetes Cluster (GKE) on Google Cloud Platform (GCP).
- Kubernetes Cloud DNS GCP now makes it easy to query DNS for Kubernetes services across multiple clusters from anywhere inside the VPC! The less stuff users have to run in their clusters, the more they can use for their own apps. It was always problematic to make users admin their own DNS.
- seroter.com: Using the new Google Cloud Config Controller to provision and manage cloud services via the Kubernetes Resource Model I look at a new managed service that provisions cloud-native services as if they were k8s resources.
- cloud.google.com: Announcing Backup for GKE: the easiest way to protect GKE workloads π
- Features of Google Kubernetes Engine that NO other K8s provider has or are rapidly copying :
- Autopilot
- Backup
- Multi-cluster Ingress
- OOTB SRE Dashboards with ASM
- Config Management across clouds
- cloud.google.com: Announcing Spot Pods for GKE Autopilotβsave on fault tolerant workloads
- acloudguru.com: GKE ludicrous speed! GKE Image Streaming speeds up container starts
- cloud.google.com: How to do multi-cluster Kubernetes in the real worldβone GKE shopβs approach
- cloud.google.com: Know more, spend less: how GKE cost optimization insights help you optimize Kubernetes
- medium.com/@glen.yu: Getting started with eBPF and Cilium on GKE Through Cilium, users can add functionality such as encryption and L7 network policy enforcement previously only available in a service mesh β but without the operational complexity of having to manage one.
- medium.com/@glen.yu: NGINX Ingress or GKE Ingress? There are tons of ingress controllers out there in the Kubernetes ecosystem, so how do we know which one is right for you? In this article, you will learn the differences between the NGINX and GKE Ingress.
IKS IBM Cloud Kubernetes Service
Linode Kubernetes Engine LKE
DOKS Digital Ocean Kubernetes
- docs.digitalocean.com: Kubernetes on DigitalOcean
- digitalocean.com: Automating GitOps and Continuous Delivery With DigitalOcean Kubernetes (Terraform, Helm and Flux)
- blog.ediri.io: DigitalOcean Kubernetes Challenge Deploy a GitOps CI/CD implementation
- digitalocean.com: Kubernetes for startups: Why, when, and how to adopt
Oracle Cloud Kubernetes
- arnoldgalovics.com: GitHub Actions CI/CD For Oracle Cloud Kubernetes Learn how to create a private container registry with Terraform and deploy a 4 node Kubernetes cluster for free on Oracle Cloud. Then, use GitHub Actions to build ARM Docker containers for your nodes.
Provisioning cloud resources (AWS, GCP, Azure) in Kubernetes
Kubesphere
- kubesphere.io The Kubernetes platform tailored for hybrid multicloud. KubeSphere is a distributed operating system managing cloud native applications with Kubernetes as its kernel, and provides plug-and-play architecture for the seamless integration of third-party applications to boost its ecosystem.
- kubekey The Next-gen Installer: Installing Kubernetes and KubeSphere v3.0.0 fastly, flexibly and easily
- kubesphere.io: Scaling a Kubernetes Cluster: One of the Best Practices for Using KubeKey
- itnext.io: Adding Master Nodes to Achieve HA: One of the Best Practices for Using KubeKey
- youtube: Create a Jenkins Pipeline on Kubernetes with CI/CD Pipeline Template in KubeSphere Two built-in Jenkins pipeline templates are available in KubeSphere 3.1. DevOps team can generate CICD or customize the workflow as you need by simple drag-and-drop.
- itnext.io: KubeSphere: A New Pluggable Kubernetes Application Management Platform
Giant Swarm
- Giant Swarm Giant Swarm offers a fully managed, open source Kubernetes platform with all the flexibility and support you need.
- giantswarm.io: We decided to go all-in with Cluster API (CAPI). “Time and again, we have seen open source win. It won with Kubernetes, and it will win with CAPI. We will continue to add our secret sauce to make it easily accessible to enterprise customers.”
Tools for multi-cloud Kubernetes management
- Banzai Cloud π
- Compare tools for multi-cloud Kubernetes management π
- NetApp Kubernetes Service – formerly StackPointCloud
- Cloudify
- Terraform
- Rancher
- Platform9 Managed Kubernetes
- Red Hat OpenShift
- Juke, from HTBase, now owned by Juniper Networks.
Videos
Click to expand!
Tweets
Click to expand!
Cloud providers after selling managed kubernetes pic.twitter.com/p9jd4Ov4Ej
— memenetes (@memenetes) November 11, 2021
Small companies managing their own Kubernetes. pic.twitter.com/nTHrqPiQnm
— joshobrien77 (@joshobrien77) November 12, 2021
AWS recently released a new version of the AWS-CNI that allows more Pods to be deployed in each EC2 instance.
— Daniele Polencic (@danielepolencic) November 22, 2021
More pod density means more efficiency, but how does it work?
And if it's that good, why release it only now?
Let's see π
π§΅ pic.twitter.com/MHnDrYJUvf