Our experience running an AI workload in Kubernetes - Part 4 <em>The Scaling Challenges</em>
KUBERNETES, KubeRay, RayService, AI Workloads, MULTI-CLOUD Jakub Hlavacka KUBERNETES, KubeRay, RayService, AI Workloads, MULTI-CLOUD Jakub Hlavacka

Our experience running an AI workload in Kubernetes - Part 4 <em>The Scaling Challenges</em>

In the previous part of this series, we walked through our migration from the RayCluster CRD to the RayService CRD. To complete the picture, this post covers the challenges we’ve faced and the improvements made to our setup running in a cost-optimized multi-cloud Kubernetes cluster.

Read More