Skip to content
Hallway
0:00 / 0:00

#taloslinux#deepseek-r1#ollama

Deepseek on bare metal Kubernetes with Talos Linux

Talos by Sidero

5.9K subscribers • 2 videos on Hallway

YouTube
  • Recommended by 1 person: 1 in engineering communities.
  • Made by the vendor. The company whose product it covers made or sponsored it.
  • May be out of date. The tools, versions or practices it shows have likely moved on.

Intermediate. Assumes working knowledge.

30K views1 year ago1 recommendation

Cloud and DevOpsAI and machine learningKubernetesTransformers and LLMsGPUs, shaders and CUDA

How to deploy DeepSeek-R1 on a bare-metal Kubernetes cluster using Talos Linux and NVIDIA GPU acceleration.

Starting from a blank computer with an NVIDIA GPU we walk through all the steps needed to deploy Deepseek-r1 as a Kubernetes workload. Sign up for Omni at siderolabs.com/omni-signup Or download and run Talos from talos.dev We use Ollama to run the model ollama.ai - Introduction - Create a cluster - Discover GPU device - Add Extensions and patches - Install ollama - Nvidia device plugin - Connect to Ollama - Outro #taloslinux #kubernetes #deepseek

Why it's here

1 person recommends this

What people say. Recommended as a step-by-step guide to running GPU-accelerated LLM workloads on bare-metal Kubernetes.

u/xrothgarxin r/kubernetes • Recommends

Deepseek on bare metal Kubernetes with Talos Linux Walks through the steps needed to run workloads that require GPU acceleration.
38View on Reddit