AI
Google Cloud, Red Hat and IBM Launch llm-d 1.0 for Distributed LLM Inference
The new open-source Kubernetes-native stack adds cache-aware routing and zero-downtime upgrades for TPU and GPU fleets in production.
llm-d
Everything Threat Times has reported about llm-d: 2 stories, newest first. Part of our AI coverage.
AI
IBM and partners launch llm-d 1.0 for on-premise AI inference
The open-source framework adds operational controls to help enterprises manage large language model workloads on internal infrastructure.