IBM and Intel Partner for AI Innovation
IBM and Intel’s collaboration will offer Intel Gaudi 3 AI accelerators as a service on IBM Cloud. Set to launch in early 2025, this service aims to help enterprises scale their AI efforts more cost-effectively while enhancing innovation with built-in security and resilience. Additionally, Gaudi 3 will be integrated into IBM’s watsonx AI and data platform. With this collaboration, IBM Cloud will become the first cloud service provider (CSP) to adopt Gaudi 3, which will be available for both hybrid and on-premise deployments.
Executive Vice President and General Manager Justin Hotard stated, “Unlocking the full potential of AI requires an open and collaborative ecosystem that provides customers with choice and accessible solutions. By integrating Gaudi 3 AI Accelerators and Xeon CPUs with IBM Cloud, we are creating new AI capabilities and meeting the demand for affordable, secure, and innovative AI computing solutions.”
Curious about other advancements in AI innovation? Check out this article
Significance
Generative AI has the power to accelerate transformation. Still, the immense computing power required highlights the importance of availability, performance, cost-efficiency, energy use, and security as top priorities for enterprises. Through their collaboration, IBM and Intel are focused on reducing the total cost of ownership while enhancing AI performance at scale. Integrating Gaudi 3 with 5th Gen Xeon processors supports enterprise AI workloads in cloud and data center environments, offering customers better visibility and control over their software stack and simplifying workload and application management. Together, IBM Cloud and Gaudi 3 aim to help businesses scale AI workloads more efficiently, focusing on performance, security, and resilience.
For generative AI inferencing, IBM plans to integrate Gaudi 3 support within its watsonx AI and data platform, providing watsonx clients with additional AI infrastructure for scaling workloads across hybrid cloud environments. This will help optimize the balance between model inference price and performance.
The GM of IBM Cloud, Alan Peacock, stated, “IBM is committed to driving AI and hybrid cloud innovation by offering solutions tailored to our clients’ business needs. Our focus on security and resilience has been central to IBM’s hybrid cloud and AI strategy for enterprise customers. By leveraging Intel’s Gaudi 3 accelerators on IBM Cloud, we provide a flexible AI solution to optimize cost and performance, unlocking new opportunities for clients to test, innovate, and deploy AI inferencing solutions cost-effectively.
Functionality
IBM and Intel are partnering to help clients across various industries, including highly regulated sectors, harness the security and compliance features of IBM Cloud to offer a Gaudi 3 service, making AI more accessible to enterprises.
Scalability and Flexibility: IBM Cloud and Intel provide scalable and flexible solutions, enabling clients to adjust computing resources as needed. This adaptability can result in cost savings and improved operational efficiency.
Enhanced Performance and Security: By integrating Gaudi 3 into IBM Cloud Virtual Servers for VPC, x86-based enterprises will benefit from faster and more secure application performance, ultimately enhancing user experiences.
Save Time and Power
- 5x faster than NV H100 on average
- 5x faster interference than NV H100 on average
- 4x higher interference power efficiency than NV H100 on average
Designed for the Real-World Demands of AI
Intel Gaudi 3 AI accelerators enable flexible system scaling with open, community-driven software and industry-standard Ethernet networking.
- Built for training and interference
- Increased memory for LLM efficiency and cost-effectiveness
- Massive, flexible on-chip networking
Looking Ahead
IBM and Intel have a long-standing partnership, spanning from creating the IBM PC to developing advanced AI solutions like Gaudi 3. IBM Cloud, powered by Gaudi 3, will be available to the public in early 2025.
Keep an eye out for more exciting updates from IBM and Intel in the coming months by signing up for our newsletter!
