Kubernetes - TrueFoundry Blog

TrueFoundry Blog

Kubernetes

A collection of 4 posts

SSH Server Containers For Development on Kubernetes

SSH Server Containers For Development on Kubernetes

Last year, we discussed running Hosted Jupyter Notebooks and VS Code (Code Server) on your Kubernetes Clusters. We compared several approaches and existing solutions including renting and managing VMs. We then described our approaches to address usability issues to make the experience nicer and abstract away Kubernetes details. Since then

Fractional GPUs in Kubernetes

Fractional GPUs in Kubernetes

Overview The GenAI revolution has led to a surge in GPU demand across the industry. Companies want to train, fine-tune and deploy LLMs in massive quantities. This has meant lower availability and consequent increase in prices for the latest GPUs. Companies running workloads on public cloud have suffered from high

Engineering and Product

Authenticated gRPC service on Kubernetes

Adding basic authentication to a service hosted on Kubernetes

The Nvidia GPU stack on Kubernetes

Engineering and Product

Enabling the Large Language Models Revolution: GPUs on Kubernetes

🚀 Why GPUs? Large language models like ChatGPT and diffusion models like Stable Diffusion have taken the world by storm in just under a year. More and more organisations are now beginning to leverage Generative AI for their existing and exciting new use cases. While most companies can directly start using