xAI, in collaboration with Supermicro and NVIDIA, has constructed Colossus, the world’s largest liquid-cooled AI supercomputer. Located in Memphis, TN, the system features over 100,000 NVIDIA HGX H100 GPUs, exabytes of storage, and advanced networking to power Grok, xAI’s generative AI chatbot. Impressively, the facility was put into operation in just 122 days.

For efficiency and scalability, Colossus uses cutting-edge liquid cooling and NVIDIA Spectrum-X Ethernet networking. Each server rack is designed for high density, housing 64 GPUs with custom cooling systems. The setup ensures serviceability and maximum performance, making it a benchmark for AI infrastructure. This project marks a milestone in supercomputing, showcasing xAI’s ambition to push technological boundaries.

Source: VentureBeat

For more details, read the full article here.