model serving inference News Overview | Tech Hub

Here’s what we found for you 👀

# model serving inference

4/15/2025

Kubeflow Ecosystem: The Future of Cloud Native AI/ML and LLMOps

Kubeflow Cloud Native ML LLMOps Kubernetes CNCF

training to inference and deployment.

4/15/2025

Kubernetes Gateway API Inference Extension: Enabling Scalable LLM Deployment in Production Environments

gateway API inference extension inference gateway Kubernetes gateway large language models Kubernetes CNCF

Traditional approaches to model serving struggle with dynamic resource requirements, heterogeneous hardware

4/15/2025

Optimizing Model Serving on Kubernetes With Model Streaming

model serving inference model weight streaming kubernetes CNCF

Traditional approaches to model serving often face significant bottlenecks, particularly during cold