GPU - TrueFoundry Blog

TrueFoundry Blog

GPU

A collection of 2 posts

Fractional GPUs in Kubernetes

Fractional GPUs in Kubernetes

Overview The GenAI revolution has led to a surge in GPU demand across the industry. Companies want to train, fine-tune and deploy LLMs in massive quantities. This has meant lower availability and consequent increase in prices for the latest GPUs. Companies running workloads on public cloud have suffered from high

The Nvidia GPU stack on Kubernetes

Engineering and Product

Enabling the Large Language Models Revolution: GPUs on Kubernetes

🚀 Why GPUs? Large language models like ChatGPT and diffusion models like Stable Diffusion have taken the world by storm in just under a year. More and more organisations are now beginning to leverage Generative AI for their existing and exciting new use cases. While most companies can directly start using