Report cover image

Generative AI: Implications for the Datacenter

Publisher IDC
Published Jul 25, 2023
Length 10 Pages
SKU # IDC18089997

Description

Generative AI: Implications for the Datacenter


This IDC Market Perspective provides insights into how the demanding energy requirements necessary to train generative AI models will change datacenter design, power distribution, cooling, and location. Because of its size, complexity, and drive toward sustainability, the market is likely to be dominated by a handful of cloud service providers, select OEMs, and niche cloud and colocation providers."Due to the intensive energy demands for training generative AI Models, datacenters performing these tasks will be purpose built, resembling other high-performance compute environment with high power density racks and liquid cooling, but they will increasingly be placed in locations outside of key metropolitan areas to take advantage of lower energy costs and free air cooling and avoid power capacity constraints," says Sean Graham, research director, IT Datacenters at IDC.

Please Note: Extended description available upon request.

Table of Contents

10 Pages
executive snapshot
New Market Developments and Dynamics
Introduction
Industry Dynamics
Foundational Model Creators
Model Users and Generative AI Application Creators
Energy Requirements for Generative AI Model Building and Generative AI Applications
Chip Requirements and Power Density
Impacts on Datacenter Design
Power Distribution
Modular Designs
Alternative Cooling Methods
Electrical and Mechanical Equipment Placement
Impacts on Datacenter Location
Sustainability
Advice for Technology Providers
Colocation
Infrastructure Providers
Learn More
Related Research
Synopsis
How Do Licenses Work?
Head shot

Questions or Comments?

Our team has the ability to search within reports to verify it suits your needs. We can also help maximize your budget by finding sections of reports you can purchase.