RunPod Blog.

Learn how much GPU VRAM your LLM actually needs for training and inference, plus how to choose the right GPU for your workload.

We're pleased to announce that H200 is now available on RunPod at a price point of $3.99/hr in Secure Cloud. This GPU spec boosts the available VRAM for NVidia-based applications up to 141GB in a single unit along with increased memory bandwidth.

Out of all of the use cases that our serverless architecture has, LLMs are one of the best examples of it. Because so much of LLM use is dependent on the human using it to process, digest, and type a response, you save so much...

Another year has come and another new card generation from NVidia is on the way. 5090s are due to become widely available this January...