Vultr cloud provider expands GPU offerings to include AMD Instinct MI300X processors alongside existing Nvidia options.

Vultr, one of the world's largest privately held cloud computing platforms, is diversifying its AI cloud inference offering with the introduction of AMD Instinct MI300X accelerators. The AMD Instinct MI300X GPUs are designed to deliver competitive performance, particularly in inference tasks, which are critical for deploying AI models in real-world applications. AMD's latest MLPerf inference results showcase the MI300X's ability to compete closely with Nvidia's H100, although Nvidia's H200 still holds a performance edge. The MI300X's performance in MLPerf benchmarks, particularly with the Llama2-70B model, validates its potential in real-world applications.

The MI300X stands out for its impressive memory capacity and processing power. With 192 GB of HBM3 memory and a peak memory bandwidth of 5.3 TB/s, the MI300X is well-equipped to handle state-of-the-art LLMs like Meta's Llama and even larger models in the future. The GPU's high compute power, extensive memory and optimized ROCm software stack contribute to its strong competitive performance. These attributes are crucial as large language models continue to scale up, necessitating efficient and cost-effective solutions for both inference and training.

Vultr's partnership with AMD capitalizes on the composable cloud infrastructure to unlock new frontiers of GPU-accelerated workloads, spanning from the data center to the edge. The integration of AMD ROCm open software further enhances this environment, offering an industry-leading platform for AI development and deployment. Vultr's offering promises improved price-to-performance ratios, scalable compute resources and optimized workload management. For enterprises engaged in AI research and development, this translates to accelerated discovery cycles and more efficient innovation processes, with the platform specifically optimized for AI inference to enable faster, more scalable and energy-efficient processing of AI models.

Vultr is not alone in recognizing the potential of AMD's latest offering. Microsoft Azure launched its ND MI300X v5 VM series powered by these GPUs earlier this year, and Oracle Cloud has also added the MI300X to its lineup, expanding the choice of available AI accelerators to customers. As cloud providers look to diversify their GPU portfolios, Vultr's collaboration with AMD stands out as an example of how the industry is evolving to meet the diverse needs of AI workloads, signaling that the future of enterprise AI lies in open, flexible environments that can adapt to the rapidly changing artificial intelligence landscape.