Marvell Announces Breakthrough Co-Packaged Optics Architecture for Custom AI Accelerators
Marvell Announces Breakthrough Co-Packaged Optics Architecture for Custom AI Accelerators
- New Marvell AI accelerator (XPU) architecture enables higher bandwidth and longer reach scale-up fabric connections for custom AI servers.
- XPUs with integrated Co-Packaged Optics (CPO) enhance AI server performance by increasing XPU density from tens within a rack to hundreds across multiple racks.
- Marvell CPO leverages multiple generations of silicon photonics technology, which has been shipping for over eight years with more than 10 billion device hours of field operation.
- 新的迈威尔人工智能加速器(XPU)架构实现了更高的带宽和更长的扩展结构连接,适用于定制的人工智能服务器。
- 集成了联合封装光学(CPO)的XPU通过将XPU密度从机架内的几十个提升到多个机架的数百个,从而增强了人工智能服务器的性能。
- 迈威尔CPO利用多代硅光子技术,已经在现场运行超过八年,设备运行总时间超过100亿小时。
SANTA CLARA, Calif., Jan. 6, 2025 /PRNewswire/ -- Marvell Technology, Inc. (NASDAQ: MRVL), a leader in data infrastructure semiconductor solutions, today announced the advancement of its custom XPU architecture with co-packaged optics (CPO) technology. Building on its recently announced custom high-bandwidth memory (HBM) compute architecture, Marvell is now extending its custom silicon leadership by enabling customers to seamlessly integrate CPO into their next-generation custom XPUs and scale-up the size of their AI servers from tens of XPUs within a rack currently using copper interconnects to hundreds across multiple racks using CPO, enhancing AI server performance. The innovative architecture enables cloud hyperscalers to develop custom XPUs that achieve higher bandwidth density and deliver longer reach XPU-to-XPU connections within a single AI server – with optimal latency and power efficiency. The architecture is now available for Marvell customers' next-generation custom XPU designs.
加利福尼亚州圣克拉拉,2025年1月6日 /美通社/ -- 迈威尔科技公司(纳斯达克股票代码:MRVL),数据基础设施半导体解决方案的领军者,今天宣布其定制XPU架构的进步,包括联合封装光学(CPO)技术。在近期发布的定制高带宽内存(HBM)计算架构基础上,迈威尔现已通过使客户能够无缝整合CPO到他们的新一代定制XPU中,拓展其定制硅片的领导地位,并将其人工智能服务器的规模从目前使用铜互连的每个机架数十个XPU扩展到多个机架数百个,提升人工智能服务器的性能。这一创新架构使云超大规模商能够开发实现更高带宽密度的定制XPU,并在单个人工智能服务器内提供更长的XPU到XPU连接,具有最佳的延迟和功率效率。该架构现已可供迈威尔客户的新一代定制XPU设计使用。
The Marvell custom AI accelerator architecture combines XPU compute silicon, HBM and other chiplets with Marvell 3D SiPho Engines on the same substrate using high-speed SerDes, die-to-die interfaces and advanced packaging technologies. This approach eliminates the need for electrical signals to leave the XPU package into copper cables or across a printed circuit board. With integrated optics, connections between XPUs can achieve faster data transfer rates and distances that are 100X longer than electrical cabling. This enables scale-up connectivity within AI servers that spans multiple racks with optimal latency and power dissipation.
迈威尔定制人工智能加速器架构将XPU计算硅、HBM和其他芯片与迈威尔3D SiPho引擎结合在同一基材上,使用高速SerDes、芯片间接口和先进的封装技术。这种方法消除了电信号需要从XPU封装中通过铜电缆或印刷电路板传出的需要。通过集成光学,XPU之间的连接可以实现比电缆快100倍的数据传输速率和距离。这使得人工智能服务器在多个机架之间能够进行扩展连接,具有最佳的延迟和功率消耗。
CPO technology integrates optical components directly within a single package, minimizing the electrical path length. This close coupling significantly reduces signal loss, enhances high-speed signal integrity, and minimizes latency. CPO enhances data throughput by leveraging high-bandwidth silicon photonics optical engines, which provide higher data transfer rates and are less susceptible to electromagnetic interference compared to traditional copper connections. This integration also improves power efficiency by reducing the need for high-power electrical drivers, repeaters and retimers. By enabling longer reach and higher density XPU-to-XPU connections, CPO technology facilitates the development of high-performance, high-capacity scale-up AI servers, optimizing both compute performance and power consumption for next-generation accelerated infrastructure.
CPO technology integrates optical components directly within a single package, minimizing the electrical path length. This close coupling significantly reduces signal loss, enhances high-speed signal integrity, and minimizes latency. CPO enhances data throughput by leveraging high-bandwidth silicon photonics optical engines, which provide higher data transfer rates and are less susceptible to electromagnetic interference compared to traditional copper connections. This integration also improves power efficiency by reducing the need for high-power electrical drivers, repeaters and retimers. By enabling longer reach and higher density XPU-to-XPU connections, CPO technology facilitates the development of high-performance, high-capacity scale-up AI servers, optimizing both compute performance and power consumption for next-generation accelerated infrastructure.
First demonstrated at OFC 2024, the industry-first Marvell 3D SiPho Engine – which supports 200Gbps electrical and optical interfaces – is a fundamental building block for incorporating CPO into XPUs. The Marvell 6.4T 3D SiPho Engine is a highly integrated optical engine with 32 channels of 200G electrical and optical interfaces, hundreds of components such as modulators, photodetectors, modulator drivers, trans-impedance amplifiers, microcontrollers, and a host of other passive components in a single, unified device to deliver 2x the bandwidth, 2x the input/output bandwidth density, and 30% lower power per bit versus comparable devices with 100G electrical and optical interfaces. Multiple customers are evaluating the technology for integration into their next-generation solutions.
First demonstrated at OFC 2024, the industry-first Marvell 3D SiPho Engine – which supports 200Gbps electrical and optical interfaces – is a fundamental building block for incorporating CPO into XPUs. The Marvell 6.4万亿 3D SiPho Engine is a highly integrated optical engine with 32 channels of 200G electrical and optical interfaces, hundreds of components such as modulators, photodetectors, modulator drivers, trans-impedance amplifiers, microcontrollers, and a host of other passive components in a single, unified device to deliver 2x the bandwidth, 2x the input/output bandwidth density, and 30% lower power per bit versus comparable devices with 100G electrical and optical interfaces. Multiple customers are evaluating the technology for integration into their next-generation solutions.
For more than eight years, Marvell has delivered silicon photonics technology for successive generations of high-performance, low power COLORZ data center interconnect optical modules. This technology has been qualified and deployed in high-volume production by numerous leading hyperscalers to satisfy their growing data center to data center bandwidth needs. Marvell silicon photonics devices have logged over 10 billion field hours.
For more than eight years, Marvell has delivered silicon photonics technology for successive generations of high-performance, low power COLORZ data center interconnect optical modules. This technology has been qualified and deployed in high-volume production by numerous leading hyperscalers to satisfy their growing data center to data center bandwidth needs. Marvell silicon photonics devices have logged over 100亿 field hours.
Marvell has been a pioneer in transforming interconnect technology to improve the performance, scalability, and economics of accelerated infrastructure. The Marvell interconnect portfolio includes high-performance SerDes and die-to-die technology IP for high-performance communication within custom XPUs, PCIe retimers for efficient short-reach connections between CPUs and XPUs on the same board, breakthrough CXL devices for overcoming memory challenges, Active Electrical Cable and Active Optical Cable digital signal processors for short-reach connections within a rack, an expanding range of PAM optical DSPs for rack-to-rack connections inside data centers and coherent DSPs and data center interconnect modules for linking data centers separated by thousands of kilometers.
迈威尔科技在转变互连技术、提升加速制造行业的性能、可扩展性和经济性方面一直处于领先地位。迈威尔科技的互连产品组合包括用于自定义XPU内部高性能通信的高性能SerDes和die-to-die技术IP,针对同一电路板上CPU与XPU之间高效短距离连接的PCIe再定时器,突破性的CXL设备用于克服内存挑战,活动电缆和活动光纤电缆数字信号处理器用于机架内的短距离连接,越来越多的PAm光学DSP用于数据中心内部机架到机架连接,以及用于连接相隔数千公里数据中心的相干DSP和数据中心互连模块。
"The Marvell custom AI accelerator with CPO architecture enables cloud hyperscalers to develop custom XPUs that will significantly increase the density and performance of their AI servers," said Will Chu, senior vice president and general manager of the Custom, Compute and Storage Group at Marvell. "Integrating optics directly into XPUs takes custom accelerated infrastructure to the next level of scale and optimization that hyperscalers must deliver to satisfy the growing demands of AI applications."
"迈威尔科技的定制人工智能加速器与CPO架构使得云超大规模公司能够开发定制的XPU,从而显著提高其AI服务器的密度和性能,"迈威尔科技定制、计算和存储集团高级副总裁兼总经理Will Chu表示。"将光学直接集成到XPU中,将定制的加速制造行业提升到超大规模公司必须提供的下一水平,以满足AI应用日益增长的需求。"
"AI scale-up servers require connectivity with higher signaling speeds and longer distances to support unprecedented XPU cluster sizes," said Nick Kucharewski, senior vice president and general manager of the Network Switching Business Unit at Marvell. "Integrating co-packaged optics into custom XPUs is the logical next step to scale performance with higher interconnect bandwidths and longer reach."
“人工智能扩展服务器需要以更高的信号速度和更长的距离来支持前所未有的XPU集群规模,"迈威尔科技网络交换业务部门高级副总裁兼总经理Nick Kucharewski表示。"将合作打包的光学集成到定制的XPU中是以更高的互连Bandwidth和更长的距离提升性能的合乎逻辑的下一步。"
"Silicon photonics is vital for scaling accelerated infrastructure connectivity to address increasing bandwidth demands, interconnect distances, power consumption, and total cost of ownership," said Radha Nagarajan, senior vice president and chief technology officer of Optical Platforms at Marvell. "Since 2017, Marvell has pioneered the delivery of high-volume silicon photonics devices to top hyperscalers and leveraged this expertise to create a cutting-edge CPO architecture for the killer CPO use case of custom XPU connectivity."
“硅光子技术对于扩展加速制造行业的互连连接至关重要,以应对不断增加的Bandwidth需求、互连距离、功耗和总拥有成本,"迈威尔科技光学平台高级副总裁兼首席技术官Radha Nagarajan表示。"自2017年以来,迈威尔科技在向顶级超大规模公司交付高成交量硅光子设备方面开创了先河,并利用这一专业技术为定制XPU连接的杀手级CPO用例创造了前沿的CPO架构。”
"Cloud hyperscalers will integrate CPO technology into their next-generation custom XPUs and scale-up servers to meet the escalating performance demands of AI. We forecast that CPO will grow from less than 50 thousand port shipments today to over 18 million CPO ports by 2029 with most of the ports being deployed for connections within servers," said Vlad Kozlov, founder and CEO, LightCounting. "With its experience in optical technology and custom XPUs, Marvell is ideally positioned to enable hyperscalers to unlock the potential of CPO and make it an integral part of their infrastructure."
"云计算超大规模公司将把CPO技术集成到他们的下一代定制XPU和高性能服务器中,以满足人工智能日益增长的性能需求。我们预测CPO的港口出货量将从今天的不到5万港口增长到2029年的超过1800万CPO港口,其中大部分港口将用于服务器内部的连接,"LightCounting的创始人兼CEO Vlad Kozlov表示。"凭借在光学技术和定制XPU方面的经验,迈威尔科技正处于理想的位置,可以帮助超大规模公司释放CPO的潜力,使其成为他们基础设施不可或缺的一部分。"
Marvell and the M logo are trademarks of Marvell or its affiliates. Please visit for a complete list of Marvell trademarks. Other names and brands may be claimed as the property of others.
Marvell和M标志是Marvell或其附属公司的商标。请访问 查看完整的Marvell商标列表。其他名称和品牌可能会被要求作为其他人的财产。
This press release contains forward-looking statements within the meaning of the federal securities laws that involve risks and uncertainties. Forward-looking statements include, without limitation, any statement that may predict, forecast, indicate or imply future events, results or achievements. Actual events, results or achievements may differ materially from those contemplated in this press release. Forward-looking statements are only predictions and are subject to risks, uncertainties and assumptions that are difficult to predict, including those described in the "Risk Factors" section of our Annual Reports on Form 10-K, Quarterly Reports on Form 10-Q and other documents filed by us from time to time with the SEC. Forward-looking statements speak only as of the date they are made. Readers are cautioned not to put undue reliance on forward-looking statements, and no person assumes any obligation to update or revise any such forward-looking statements, whether as a result of new information, future events or otherwise.
本新闻稿包含根据联邦证券法定义的前瞻性陈述,这些陈述涉及风险和不确定性。前瞻性陈述包括但不限于,任何可能预测、预示、指示或暗示未来事件、结果或成就的陈述。实际事件、结果或成就可能与本新闻稿中考虑的内容有重大差异。前瞻性陈述仅仅是预测,并且受到风险、不确定性和难以预测的假设的影响,包括在我们提交给SEC的《10-k表格年报》、《10-Q表格季报》和其他文件的“风险因素”部分所描述的内容。前瞻性陈述仅在作出之日有效。提醒读者不要过度依赖前瞻性陈述,任何人都没有义务更新或修改任何此类前瞻性陈述,无论是由于新信息、未来事件还是其他原因。
For further information, contact:
pr@marvell.com
欲了解更多信息,请联系:
pr@marvell.com
SOURCE Marvell
来源 迈威尔科技