Kubernetes

In an attempt to confirm Kubernetes’ move beyond hype to widespread enterprise adoption, Francesc Campoy and Victor Coisne used source{d} Engine to analyze all the Kubernetes git repositories through SQL queries. Here’s a snapshot of what they learned. At its outset in 2014, the Kubernetes project had 15 programming languages, a number that quickly increased to 35 by the beginning of 2017. Given that Kubernetes came from Google, it’s not surprising to see that Go is by far the dominant language followed by Python, YAML and Markdown. The analysis shows that other languages such as Gradle and Lua have been dropped while some others like Assembly, SQL and Java made a comeback. The full results of the analysis are available upon request via a link shared at the end of the blog post.

Joe Doliner (JD) joined the show to talk about productionizing ML/AI with Pachyderm, an open source data science platform built on Kubernetes (k8s). We talked through the origins of Pachyderm, challenges associated with creating infrastructure for machine learning, and data and model versioning/provenance. He also walked us through a process for going from a Jupyter notebook to a production data pipeline.

kubefwd is an open source command line tool for quickly enabling a painless approach to the local development of applications that interact with other services in a Kubernetes cluster. Kelsey Hightower says: kubefwd is the tool I’ve been missing.

Heptio is the startup founded by 2 of the co-founders of Kubernetes. We had been working on getting some time planned with the CEO Craig McLucki and CTO Joe Beda, but both were “unavailable” to speak. This acquisition might be one of the reasons why. From Ingrid Lunden’s coverage on TechCrunch: VMware acquires Heptio — a startup out of Seattle that was co-founded by Joe Beda and Craig McLuckie (two of the three people who co-created Kubernetes back at Google in 2014) Beda and McLuckie and their team will all be joining VMware in the transaction. More details can be found on the Heptio blog announcement. As for the terms of the deal, they “are not being disclosed.” For reference, when Heptio last raised money ($25M Series B in 2017) it was valued at $117M post-money. So, I’m estimating this deal to be in the $300M-$500M range. To Craig and Joe — first, congrats. Second, we’re still interested in talking with you. Maybe now is a better time and the details you couldn’t share before can now be more freely shared. This is an open invite, to you both! Congrats also to the team at Heptio for all the hard at work you’re doing to advance Kubernetes and cloud orchestration! What a ride the past few weeks for commercial open source in this recent wave of acquisitions.

Last week, Admiralty open-sourced multicluster-controller, a Go library for building hybrid and multicloud Kubernetes operators. It is the equivalent of operator-sdk or kubebuilder, but for multiple clusters. It is actually a thin layer around parts of controller-runtime, the library that powers kubebuilder. It can be used to control custom resources (defined by CRDs) across clusters.

Just in time for #Hacktoberfest! The Non-Code Contributor’s Guide aims to make it easy for anyone to contribute to the Kubernetes project in a way that makes sense for them. This can be in many forms, technical and non-technical, based on the person’s knowledge of the project and their available time. Most individuals are not developers, and most of the world’s developers are not paid to fully work on open source projects. Based on this we have started an ever-growing list of possible ways to contribute to the Kubernetes project in a Non-Code way!

What happens when you boot up a Pod? What happens to a Service before it is allocated a public IP address? How often is a Deployment's status changing? I have no clue, but kubespy will help answer those questions in real time.

We talk with Dan Kohn, the Executive Director of the Cloud Native Computing Foundation to catch up with all things cloud native, the CNCF, and the world of Kubernetes. Dan updated us on the growth KubeCon / CloudNativeCon, the state of Cloud Native and where innovation is happening, serverless being on the rise, and Kubernetes dominating the enterprise.

In this highly visual and scroll friendly post from Daniele, you’ll follow the evolution of monolith, to components, to VMs, to today’s world of Kubernetes and cloud. Daniele writes: Kubernetes and Docker? What is the difference? Is it just a fad or are those two technologies here to stay? If you heard about the Docker and Kubernetes, but you aren’t sold on the idea and don’t see the point in migrating, this article is for you. Learn how you can leverage Kubernetes to reduce infrastructure costs and accelerate your software delivery.

Feature highlights of the beta CPU Manager in Kubernetes from Balaji Subramaniam, Cloud Software Engineer and Connor Doyle, Cloud Software Architect at Intel AI… A single compute node in a Kubernetes cluster can run many pods and some of these pods could be running CPU-intensive workloads. In such a scenario, the pods might contend for the CPU resources available in that compute node. When this contention intensifies, the workload can move to different CPUs depending on whether the pod is throttled and the availability of CPUs at scheduling time. There might also be cases where the workload could be sensitive to context switches. In all the above scenarios, the performance of the workload might be affected. If your workload is sensitive to such scenarios, then CPU Manager can be enabled to provide better performance isolation by allocating exclusive CPUs for your workload.

Paul Dix, Founder and CTO of InfluxData, writes on the InfluxData blog: I attended and spoke at KubeCon EU. It was a massive event attended by around 4,700 people … However, I felt there was an underlying problem … everyone I spoke with was either an operator or an SRE. Where were all the application developers? Aren’t those the people that all this complex infrastructure is supposed to serve? Which raised questions for Paul, like… Is Kubernetes too complex? Will it end up collapsing under the weight of its own complexity? Will it fade away as OpenStack has seemed to since 2014? And Paul walked away from KubeCon EU with this perspective: Application developers would be better served by having a happy path to follow with the tools preselected … CNCF’s increasing complexity and broader reach might dilute the focus and brand of Kubernetes … I’m not sure what the answer might be to this or if I’m overblowing it, but from my perspective at the conference, it was like tool porn. Why bother with solving user problems when you can spend your entire career learning about and building new tools for infrastructure?

Is Netflix Titus open source yet? Yes. Titus powers critical aspects of the Netflix business, from video streaming, recommendations and machine learning, big data, content encoding, studio technology, internal engineering tools, and other Netflix workloads So, why is Netflix open sourcing Titus? …we’ve been asked over and over again, “When will you open source Titus?” It was clear that we were discussing ideas, problems, and solutions that resonated with those at a variety of companies, both large and small. We hope that by sharing Titus we are able to help accelerate like-minded teams, and to bring the lessons we’ve learned forward in the container management community. The question is, is it too late for Titus to gain traction in a world where Kubernetes has seemingly already won?

K8s is a powerful platform which can be abused in many ways if not configured properly. Contributors to this guide are running Kubernetes in production and worked on several K8s projects to learn about security flaws the hard way. This guide scores major points for having battle-hardened contributors. I also dig how they indicate the severity/importance of each topic with an emoji. Look out for the 💥s!

Ever since Heroku delivered git push-based deploys back in the day, the open source community has been hard at work creating alternative solutions with similar UX. Gitkube is the latest tool in this space, combining Docker and Kubernetes to get you started with your own git-based automation.

Mike Coleman, Docker Technology Evangelist, writing on the Docker blog: If you’re running an edge version of Docker on your desktop (Docker for Mac or Docker for Windows Desktop), you can now stand up a single-node Kubernetes cluster with the click of a button. If you are running Docker for Mac or Docker for Windows, you now have a fully compliant Kubernetes cluster at your fingertips without installing any other tools.

From KubeCon + CloudNativeCon 2017 — Brendan Burns (Kubernetes co-founder) and Gabe Monroy (creator of Deis) joined us on The Changelog to talk about the origin, impact, and future of Kubernetes and cloud infrastructure. If Kubernetes let’s you not think about your machines, I think in many cases people don’t even want to have machines, this move towards serverless containers and the orchestration of serverless containers is the next really important part of what we’re doing. — Brendan Burns, Kubernetes co-founder

This is a big deal. We’ve been tracking CoreOS since the beginning — we’re huge fans of Alex, Brandon and the team behind CoreOS. Red Hat has signed a definitive agreement to acquire CoreOS, Inc., an innovator and leader in Kubernetes and container-native solutions, for a purchase price of $250 million. Red Hat is a publicly traded company and while this announcement hasn’t really impacted shareholder value (yet), we, the open source community have been immeasurably impacted by the team behind CoreOS. Also, check out Alex Polvi’s announcement on the CoreOS blog which includes some details and backstory.

Are you really pushing Kubernetes? No? OpenAI is… We’ve been running Kubernetes for deep learning research for over two years. While our largest-scale workloads manage bare cloud VMs directly, Kubernetes provides a fast iteration cycle, reasonable scalability, and a lack of boilerplate which makes it ideal for most of our experiments. We now operate several Kubernetes clusters (some in the cloud and some on physical hardware), the largest of which we’ve pushed to over 2,500 nodes. This cluster runs in Azure on a combination of D15v2 and NC24 VMs.

Adam and Jerod jumped in as hosts for an experiment in quantum podcasting, letting Erik and Brian play guests to talk about Virtual Kubelet, building OSS at Microsoft, BBQ (of course), and other interesting projects and news.

Docker for macOS makes it easy to have Docker containers running on your Mac in just a few minutes and now it has experimental Kubernetes support. We’re proud to announce that Docker for Mac with beta Kubernetes support is now publicly available as part of the Edge release channel. With this release you can now run a single node Kubernetes cluster right on your Mac and use both kubectl commands and docker commands to control your containers.