SambaNova and Intel have announced an extended collaboration to introduce a cutting-edge heterogeneous hardware solution that combines GPUs, Intel Xeon 6 processors, and SambaNova RDUs for optimized AI performance. This innovative approach assigns specific tasks to hardware best suited for each step, resulting in faster and higher-quality AI responses suitable for scaled agentic workloads.
Rodrigo Liang, CEO and co-founder of SambaNova Systems, emphasized the significance of this collaboration, stating that the combination of GPUs, Intel Xeon 6 processors, and SambaNova RDUs provides a winning pattern for efficient AI production. This collaboration aims to offer customers a blueprint for deploying AI solutions in existing air-cooled data centers, leveraging the familiar x86 architecture.
Kevork Kechichian, executive vice president and general manager of Intel’s Data Center Group, highlighted the importance of a heterogeneous mix of computing for future workloads. He emphasized that the data center software ecosystem is built on x86 and relies on Xeon processors for optimal performance.
Banghua Zhu, co-founder and CTO of AI infrastructure startup RadixArk, noted that production inference is shifting towards heterogeneous hardware to achieve optimal performance throughout the agentic workflow.
The architecture developed by Intel and SambaNova is centered around Intel Xeon 6 processors and SambaNova RDUs, with the SN50 RDU offering high-throughput, low-latency decode for large language models. The Xeon 6 chip provides essential memory bandwidth, accelerators, and PCIe lane density for seamless operation.
In testing, Intel Xeon 6 processors outperformed Arm-based server CPUs, delivering up to 50% faster performance. Additionally, Xeon 6 excelled in vector database operations, offering up to 70% faster performance compared to other architectures.
The integration of Xeon 6 processors as host CPUs ensures efficient task coordination, system control, and workload distribution. This setup eliminates the need for specialized data centers, liquid cooling, and custom power infrastructure, making it an ideal solution for standard data center environments.
Overall, the collaboration between SambaNova and Intel promises a game-changing approach to AI infrastructure, offering high-performance and energy-efficient solutions for a wide range of applications.
