Quarkus at KubeCon Europe 2024

[insectengine]

Event Description: The Cloud Native Computing Foundation’s flagship conference gathers adopters and technologists from leading open source and cloud native communities.

Date: March 19-22
Location: Paris, France
Event Type: In Person

https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/

Wednesday

Session Title: Is Serverless Powerfully Powerless?
Speaker(s): Kevin Dubois & Jose Gomez-Selles
Date/Time: Wednesday March 20, 2024 11:15 - 11:50 CET
Location: Pavilion 7 | Level 7.1 | Room A
Abstract: One of the main benefits and selling points of serverless solutions like Knative is that it saves CPU cycles and RAM consumption (and by extension, money) by only using resources when they are actually needed. Because of that, we would semi-automatically infer that using a serverless approach when architecting our applications is the way to go if we want to be efficient and do our planet a favor by saving energy. But wouldn’t it be nice to, actually, have some data to support this statement? Until very recently, we could only guess. But technology is advancing fast and now we have tools to observe and test this hypothesis. In this talk we will show if, and if so how much, serverless can save not only in computing power but real energy as well. We will do this by actually measuring energy consumption of nodes and workloads with Kepler and shed some light on this topic to figure out if our assumptions are true, or just a myth which needs to be busted.

Session Title: Tutorial: Cloud Native Sustainable LLM Inference in Action
Speaker(s): Chen Wang, Eun Kyung Lee & Bo Wen, IBM; Huamin Chen, Red Hat; Cathy Zhang, Intel
Date/Time: Wednesday March 20, 2024 14:30 - 16:00 CET
Location: Pavilion 7 | Level 7.3 | N01-02
Abstract: Join our tutorial on sustainable Large Language Models (LLM) inference using cloud-native tech. We'll cover LLMs, energy use, and Kepler's role in monitoring power during LLM workloads. Learn about balancing environmental sustainability and tech efficiency, using AI accelerator frequency adjustments in Cloud Native tech for optimized LLM inference. This ensures power efficiency and cost-effectiveness. Experience a live demo of vLLM, an advanced inference framework, in action. See how we tweak AI accelerator settings in a Kubernetes cluster for ideal power-computation balance. This tutorial is a must-attend for professionals keen on integrating environmental sustainability with cloud-native technology solutions. Whether you're a developer, an IT specialist, or a sustainability advocate, you'll gain valuable insights into the future of eco-friendly cloud computing. Join us to be at the forefront of this significant technological evolution.

Session Title: Self-Hosted LLMs on Kubernetes: A Practical Guide
Speaker(s): Hema Veeradhi & Aakanksha Duggal, Red Hat
Date/Time: Wednesday March 20, 2024 14:30 - 15:05 CET
Location: Pavilion 7 | Level 7.1 | Room F
Abstract: Have you ever considered deploying your own large language model (LLM), but the seemingly complex process held you back from exploring this possibility? The complexities of deploying and managing LLMs in production environments often pose significant challenges. This talk will serve as a comprehensive introductory guide, empowering beginners to commence their LLM journey by effectively hosting their own models on Kubernetes. We will discuss the process of selecting appropriate open source LLM models, containerization of the models, and creating Kubernetes deployment manifests and resource provisioning to support the LLM's computational needs. Self-hosted LLMs offer enhanced data privacy, flexibility in model training, and reduced operational costs, making them an attractive option for organizations seeking greater control over their AI infrastructure. By the end of this talk, attendees will possess the necessary skills and knowledge to navigate the exciting path of self-hosting LLMs.

Session Title: How to Choose the Best Kubernetes AI Edge Deployment Patterns for Your Use Case
Speaker(s): Jacqueline Koehler & Myriam Fentanes Gutierrez, Red Hat
Date/Time: Wednesday March 20, 2024 14:30 - 15:05 CET
Location: Pavilion 7 | Level 7.3 | S04
Abstract: As a Machine Learning Operations (MLOps) Engineer focused on AI at the edge, you will be faced with many unique challenges and decisions. You may have many questions such as: How do I handle distributed architectures across hybrid environments? How do I manage all the data being produced at the edge and getting that data to the core hub for useful insights? What do I do with my old devices running critical analytics? How do I manage my far edge deployments that are disconnected? There are multiple options to solve the above issues and the best option heavily depends on the industry and use case. Our goal is to help you with answering all of these questions so you can decide how to select the best deployment patterns for your AI at the edge. Using Kubernetes and Open Data Hub, we will show a live demo using MLOps pipelines, Open Cluster Management, and OpenTelemitry to deploy a model to the edge and gather, store, and forward key metrics to the central hub.

Session Title: Chart Your Course Like a Champion
Speaker(s): Andrew Block & Karena Angell, Red Hat; Joe Julian, Stealth Startup; Scott Rigby, Independent
Date/Time: Wednesday, March 20 • 16:30 - 17:05
Location: Pavilion 7 | Level 7.3 | N03
Abstract: Helm provides the features and capabilities to package and manage Kubernetes applications with ease. However, are you properly taking advantage of all of the features that Helm has to offer? In this session, join Helm project maintainers as they highlight some of the key ways that you can elevate your use of Helm and become a helm chart champion. Areas in particular include: * Chart structuring * Templating * Dependency management * Chart testing and releasing Cross the finish line with the knowledge that you can’t afford to miss!

Session Title: Build Your Contributor Base
Speaker(s): Josh Berkus & Ali Ok, Red Hat; Dawn Foster, CHAOSS; Catherine Paganini, Buoyant; Sandeep Kanabar, NortonLifeLock)
Date/Time: Wednesday March 20, 2024 16:30 - 17:05 CET
Location: Pavilion 7 | Level 7.3 | E05 - E06
Abstract: You’ve joined the CNCF, your technology is great, you’ve done several releases, and you even have a nice web page. So why isn’t your project attracting more contributors? TAG Contributor Strategy is here to help you with tips, ideas, and guides on how to attract, retain, and promote contributors to your project. This session will include a brief snapshot of the TAG’s many contribution guides, plus tips from project leaders who have grown their projects, including: - How to use roadmaps to recruit contributors - Retention, promotion, and ladders - Making your project more accessible - Contributor recognition - Monitoring recruitment and growth - Mentoring: not just for students If you lead any part of an open source project, please join us and learn how to accelerate your contributor growth.

Session Title: Developers Demand UX for K8s!
Speaker(s): Máirín Duffy, Red Hat, Inc. & Conor Cowman, Atlantic Technological University
Date/Time: Wednesday March 20, 2024 16:30 - 17:05 CET
Location: Pavilion 7 | Level 7.3 | S02
Abstract: Who hasn't had their app break due to a mismatch between devel and prod environments? Developers still write YAML by hand - or more often, compose files handed off to SRE for a YAML rewrite. An issue occurs in Kubernetes, and you're stabbing in the dark trying to access running object states to assess the problem. Why is working with K8s still so frustrating for developers? The answer: There isn't enough user experience (UX) focus on developers in K8s. K8s is more oriented towards ops and SREs than developers, developers find setting up a local environment difficult, and Kubernetes generally intimidates them. We engaged in a three-month long user research study of developers and the platform engineers who support them on their Kubernetes usage. We'll present our findings, and you'll gain insight into workflows and pain points of developers working with Kubernetes. Get inspired to help improve the UX for developers you work with, and learn how you can run your own study!

Session Title: Savoir Faire: Cloud Native Technical Leadership
Speaker(s): Arun Gupta, Intel; Nikhita Raghunath, VMware; Lin Sun, solo.io; Emily Fox, Red Hat; Nancy Chauhan, LocalStack
Date/Time: Wednesday March 20, 2024 17:25 - 18:00 CET
Location: Pavilion 7 | Level 7.3 | S01
Abstract: Like baking a loaf of Pain Poilâne, technical leadership requires a balance of ingredients and continued practice and refinement of skills to create valuable and positive change. Renowned Parisian baker Lionel Poilâne believed the process is the most important aspect of vision. Cloud native technical leadership isn't any different, it is the exemplification of cloud native values in the communications, decisions, and commitment we make to the ecosystem. As individuals, we are responsible for our “loaves” or work from start to finish. But what does it mean? How can we create a recipe for other technologists to replicate those contributions to our projects and community successes? In this Panel, Technical Leaders across the cloud native ecosystem will share their experiences, insights, and methods to provide accessible explanations on being cloud native technical leaders across an international, diverse community of cloud native technologists.

Thursday

Session Title: Sponsored Keynote: A Cloud Native Overture to Enterprise End User Adoption
Speaker(s): Fabian Deutsch, Senior Engineering Manager, Red Hat & Michael Hanulec, Vice President and Technology Fellow, Goldman Sachs
Date/Time: Thursday March 21, 2024 09:40 - 09:45 CET
Location: Pavilion 7 | Level 7.3 | Paris Room
Abstract: When is music at its best? When you are in concert. Goldman Sachs - a Cloud Native End User - was envisioning this for their applications:

Eliminating intermediate layers, reducing complexity, and putting their applications closer to where the harmonies blend - close to the platform. Kubernetes - paired with KubeVirt, as well as other CNCF ecosystem projects such as Prometheus, Argo CD, and Rook - is now serving as a unified, open-source, and forward looking platform, running thousands of their existing VMs at scale. And setting the stage for a frictionless adoption of cloud-native applications and development models.

We’ll look at:

• How Goldman Sachs is shifting their existing VM real estate to Kubernetes and KubeVirt, and how it’s run at scale
• Why Kubernetes and the cloud-native ecosystem unlocks and accompanies their technical transformation by collaborating with the community and giving them access excellence and innovation
• Why starting with existing real estate was not a mishap, but the beginning of a journey

Session Title: Fortifying AI Security in Kubernetes with Confidential Containers (CoCo)
Speaker(s): Suraj Deshmukh, Microsoft & Pradipta Banerjee, Red Hat
Date/Time: Thursday, March 21 • 14:30 - 15:05
Location: Pavilion 7 | Level 7.3 | Paris Room
Abstract: AI models have become valuable intellectual property that can provide organizations with a competitive edge. Users are searching for ways to secure their AI models without implicitly trusting third-party platform providers. While encryption is available to keep models secure when they’re stored & transferred, they’re still decrypted & loaded into memory during inferencing, potentially exposing them to unintentional or intentional exfiltration. This is where "confidential computing" comes in. This technology encrypts memory to protect data in use. Confidential Containers (CoCo) is a CNCF sandbox project that aims to bring confidential computing to k8s. The k8s AI/ML ecosystem is mature & offers many AI/ML training & inferencing options. The focus is on using CoCo with Kserve project to show how CoCo strengthens AI model protection. Apart from inferencing, we will explore broader application of CoCo, emphasizing its role in providing general memory protection for foundational platforms.

Session Title: Tutorial: Exploring the Power of Distributed Tracing with OpenTelemetry on Kubernetes
Speaker(s): Pavol Loffay & Benedikt Bongartz, Red Hat; Matej Gera, Coralogix; Anthony Mirabella, AWS; Anusha Reddy Narapureddy, Apple
Date/Time: Thursday March 21, 2024 14:30 - 16:00 CET
Location: Pavilion 7 | Level 7.3 | N01-02
Abstract: Rolling out an observability solution is not a straightforward problem. There are many solutions and the final architecture can impact the effectiveness, robustness, and long-term maintenance aspects of the architecture. In this comprehensive tutorial, we will deploy an end-to-end distributed tracing stack on Kubernetes using the OpenTelemetry project. The tutorial will cover both manual and auto-instrumentation, extending the auto-instrumentation, collecting data with the OpenTelemetry collector and performing transformation on spans using OTTL, tail-based sampling, deriving metrics from traces, tracing with proxies/service meshes and collecting traces from Kubernetes infrastructure. After this session, the audience will be able to understand and use OpenTelemetry API/SDK, auto-instrumentation, collector, and operator to roll out a working distributed tracing stack on Kubernetes.

Session Title: Tutorial: From CNI Zero to CNI Hero: A Kubernetes Networking Tutorial Using CNI
Speaker(s): Doug Smith & Tomofumi Hayashi, Red Hat
Date/Time: Thursday March 21, 2024 16:30 - 18:00 CET
Location: Pavilion 7 | Level 7.3 | N01-02
Abstract: Doug and Tomo are here to show you just how CNI works from the ground level up. You’ll go from zero CNI knowledge to CNI hero after we walk you through all the layers of using CNI for the first time. How do you configure a CNI plugin? When does CNI execute? How do you build a CNI plugin? How do you debug one? We’ll answer all those questions, and more. In our hands-on tutorial we’ll give you a tour of all the moving parts when it comes to CNI, from how CNI is executed by the runtime, to how a CNI plugin operates. We’ll even walk through our opinionated boilerplate for writing a CNI plugin that interfaces with Kubernetes by accessing the Kubernetes API, from our experience developing CNI plugins, such as Multus and Whereabouts IPAM CNI. You’ll walk away with sample code and techniques so that you can not only better manage and understand how CNI is working behind the scenes, but also an ability to use it creatively to solve problems and create new functionality for your clusters.

Friday

Session Title: Keynote: Cloud Native in its Next Decade
Speaker(s): Erin Boyd, Engineer, Red Hat & Lin Sun, Head of Open Source, solo.io
Date/Time: Friday March 22, 2024 10:05 - 10:20 CET
Location: Pavilion 7 | Level 7.3 | Paris Room
Abstract: When we started CNCF in 2015 to help advance container technology, Kubernetes was the seeding technology to provide a de facto container orchestration platform for all cloud native applications. Almost a decade later, the community has exploded with 180+ open source projects building on top of cloud native technologies. Looking ahead, what challenges will we have in the next decade? They will be vastly different for our users and contributors from today.

Let us review some of the key CNCF projects today and lay out some possible avenues for where cloud native is going for the next decade, AI, sustainability, edge computing, security, service mesh, web assembly and more.
Right or wrong, we’ll find out at KubeCon 2034!

Session Title: SIG Instrumentation Introduction and Deep Dive
Speaker(s): Han Kang, Google & Damien Grisonnet, Red Hat
Date/Time: Friday March 22, 2024 11:55 - 12:30 CET
Location: Pavilion 7 | Level 7.3 | W02-03
Abstract: Kubernetes SIG Instrumentation is responsible for ensuring high quality and consistent instrumentation across the Kubernetes project. We will begin with an introductory overview of the efforts the SIG Instrumentation has worked on in the past and is currently working on. This deep dive session will go into detail about currently ongoing efforts happening within SIG Instrumentation to share with the audience concrete pieces of work to encourage future collaboration. Software engineering and operations are both disciplines practiced in SIG Instrumentation, and any experience will help the special interest group's mission. Join this session to learn how to get involved in SIG Instrumentation to make instrumentation even better!

Session Title: You Shall Not Pass! Unless You Are GUAC Verified…
Speaker(s): Parth Patel, Kusari & Dejan Bosanac, Red Hat
Date/Time: Friday March 22, 2024 16:00 - 16:35 CET
Location: Pavilion 7 | Level 7.1 | Room D
Abstract: Having the most up-to-date information when you have to make a decision is always key. This statement is true for many real-world applications but is paramount for software supply chain security! To comply with the Executive Order 14028, we now have mountains of metadata from SBOMs, SLSA attestations, vulnerability information, and various in-toto ITE-6 attestations at our fingertips. With the introduction of projects like GUAC and Trustification, these can now be collected and analyzed successfully. Combining this information with policy engines, like OPA , we can create a policy that validates if a specific container or artifact is allowed to run in a cluster based on its security assessment. In this presentation, we will explain the concepts behind GUAC and Trustification projects. Next, we will demonstrate how OPA can be integrated with GUAC to create a policy that can answer the question: “Is the artifact allowed to be run in this environment?”.

Session Title: Contribfest: The PRs Must Flow - A KubeVirt Contributor Workshop
Speaker(s): Andrew Burden, Brian Carey, Alice Frosi, Daniel Hiller, Luboslav Pivarc
Date/Time: Friday March 22, 2024 16:00 - 17:30 CET
Location: Pavilion 7 | Level 7.3 | E07
Abstract: Want to contribute but aren't sure where to start? Have a bugfix or a cool feature that couldn't gain traction? The KubeVirt maintainers are here for you. KubeVirt is an incubating project that extends Kubernetes so that you can manage virtual machines natively in your cluster. In this friendly, hands-on session, new and seasoned contributors alike will learn how easy it is to contribute features to the ecosystem: starting with a guide to the project (and its many repos), how to run a test cluster to verify changes, and what you can expect from our community. We will then split into groups and dive into some feature work. We also have members from our amazing infra team for those who want to learn how to write better tests and about keeping CI healthy. Non-code contributors welcome but you should be familiar with Github. For maximum enjoyment, please bring a laptop that you can work on. Bonus points if you download the kubevirt/kubevirt repo ahead of time.