Shubham Rai - TrueFoundry Blog

TrueFoundry Blog

Shubham Rai

Fractional GPUs in Kubernetes

Fractional GPUs in Kubernetes

Overview The GenAI revolution has led to a surge in GPU demand across the industry. Companies want to train, fine-tune and deploy LLMs in massive quantities. This has meant lower availability and consequent increase in prices for the latest GPUs. Companies running workloads on public cloud have suffered from high

Is AI Workload Bloating Up Your Cloud Bill?

Thought Leadership

Is AI Workload Bloating Up Your Cloud Bill?

We firmly believe that every company will be a Machine Learning (ML) company in the coming few years. As organizations embrace ML, one of the significant challenges they face is managing the associated cloud costs. Running AI/ML workloads in the cloud can quickly become expensive, but with careful planning

Engineering and Product

Application Development With Kubernetes

Kubernetes is widely regarded as the ideal platform for teams in large and mid-size organizations with high availability and autoscaling requirements. However, it has also added friction to existing developer workflows. This change can be understood as part of a broader push towards the adoption of the micro-service paradigm and