Report cover image

Development Trends of AI Servers: From Full System to Rack-Level Design

Published Aug 14, 2024
Length 14 Pages
SKU # MICI19086835

Description

Development Trends of AI Servers: From Full System to Rack-Level Design


Since the beginning of 2024, the artificial intelligence (AI) server market has experienced a significant surge, with numerous manufacturers unveiling their latest AI server products at Computex 2024. In addition to the servers themselves, major chipmakers like Nvidia, AMD, and Intel also showcased a wide array of rack-level and thermal management solutions, with the Nvidia DGX GB200 NVLink 72 standing out as a key product. This shift marks an important development for pure server manufacturers, who are now focusing not only on server production but also on advancing into the supply chain for rack-level solutions. This report provides insights into the latest development trends in the AI server market, examining the new rollouts from leading GPU suppliers. It also explores the major product strategies of prominent AI server manufacturers such as Supermicro, Ingrasys, QCT, and Gigabyte, alongside traditional server manufacturers like Wiwynn, Inventec, and Tyan, as revealed through their product launches at Computex 2024.

Table of Contents

14 Pages
    • AI Servers Featuring Nvidia HGX and MGX Architectures
    • AMD and Intel Separately Collaborate with Manufacturers to Enter the AI Server Market
    • Manufacturers Compete with Nvidia DGX GB200 NVLink 72 Racks within the Same Architecture
    • Manufacturers Seek Differentiation in Rack Design, Collaborating with Various Upstream and Liquid Cooling Vendors
    • The AI Server Market Remains Hot, with a Significant Increase in Product Specs and the Number of Vendors
    • Air-Cooled and Liquid-Cooled Servers Target Different Customer Groups; Liquid Cooling Enhances AI Computing Density in a Single Rack
    • High Power Consumption of AI Servers Accelerates the Adoption of Liquid Cooling, Making Rack-Level Solutions a Norm
    • Nvidia Continues to Dominate the AI Server Market, with AMD and Intel Making Progress AI
    • List of Companies
How Do Licenses Work?
Request A Sample
Head shot

Questions or Comments?

Our team has the ability to search within reports to verify it suits your needs. We can also help maximize your budget by finding sections of reports you can purchase.