Storage Considerations When Using Accelerated Compute in Enterprise Artificial Intelligence Environments
Description
Storage Considerations When Using Accelerated Compute in Enterprise Artificial Intelligence Environments
This IDC Perspective discusses how artificial intelligence (AI) workloads in the enterprise introduce new storage requirements. As AI–driven workloads become more widely deployed in the enterprise, standard access methods like NFS and SMB will begin to impose performance limitations for some stages of the AI data pipeline. Enterprises are already starting to look at parallel scale-out file system platforms (which had traditionally been sold primarily in HPC markets) and their intelligent, highly parallel, POSIX–compliant clients to meet these performance requirements. Increasingly, four different types of enterprise storage vendors (clustered scale-up file, distributed scale-out file, parallel scale-out file, and object-based storage) will be competing for the chance to handle customers' unstructured data storage requirements, and IT managers need to understand the pros and cons of each approach before making a storage purchase decision. Accelerated compute (i.e., GPUs) is often also required when it comes to AI workloads and achieving efficient integration with storage to optimize compute resource utilization introduces additional considerations into the storage purchase decision."Artificial intelligence workloads are penetrating the enterprise and driving new requirements for performance, availability, and scalability in the underlying storage infrastructure," said Eric Burgener, research vice president, Infrastructure Systems, Platforms, and Technologies Group, IDC. "To effectively drive these big data analytics–oriented workloads, enterprises will need new storage architectures that offer massive parallelism and increased infrastructure efficiencies, and they are increasingly looking outside of traditional unstructured data storage architectures to get them."
Please Note: Extended description available upon request.
This IDC Perspective discusses how artificial intelligence (AI) workloads in the enterprise introduce new storage requirements. As AI–driven workloads become more widely deployed in the enterprise, standard access methods like NFS and SMB will begin to impose performance limitations for some stages of the AI data pipeline. Enterprises are already starting to look at parallel scale-out file system platforms (which had traditionally been sold primarily in HPC markets) and their intelligent, highly parallel, POSIX–compliant clients to meet these performance requirements. Increasingly, four different types of enterprise storage vendors (clustered scale-up file, distributed scale-out file, parallel scale-out file, and object-based storage) will be competing for the chance to handle customers' unstructured data storage requirements, and IT managers need to understand the pros and cons of each approach before making a storage purchase decision. Accelerated compute (i.e., GPUs) is often also required when it comes to AI workloads and achieving efficient integration with storage to optimize compute resource utilization introduces additional considerations into the storage purchase decision."Artificial intelligence workloads are penetrating the enterprise and driving new requirements for performance, availability, and scalability in the underlying storage infrastructure," said Eric Burgener, research vice president, Infrastructure Systems, Platforms, and Technologies Group, IDC. "To effectively drive these big data analytics–oriented workloads, enterprises will need new storage architectures that offer massive parallelism and increased infrastructure efficiencies, and they are increasingly looking outside of traditional unstructured data storage architectures to get them."
Please Note: Extended description available upon request.
Table of Contents
11 Pages
- Executive Snapshot
- Situation Overview
- The Road to the Enterprise for Parallel Scale-Out File System Vendors
- The Rise of Converged Infrastructure Stacks
- NVIDIA GPUDirect Storage
- How This Will Impact Unstructured Data Storage Strategies
- Advice for the Technology Buyer
- Learn More
- Related Research
- Synopsis
Pricing
Currency Rates
Questions or Comments?
Our team has the ability to search within reports to verify it suits your needs. We can also help maximize your budget by finding sections of reports you can purchase.
