CoreWeave First to Market With NVIDIA H200 Tensor Core GPUs, Ushering in a New Era of AI Infrastructure Performance
CoreWeave First to Market With NVIDIA H200 Tensor Core GPUs, Ushering in a New Era of AI Infrastructure Performance
CoreWeave's innovative Mission Control platform delivers performant AI infrastructure with high system reliability and resilience, enabling customers to use NVIDIA H200 GPUs at scale to accelerate the development of their generative AI applications
CoreWeave创新的Mission Control平台提供了高性能的AI基础架构,具有高系统可靠性和弹性,使客户能够大规模使用NVIDIA H200 GPU来加速其生成式AI应用的开发
ROSELAND, N.J., Aug. 28, 2024 /PRNewswire/ -- CoreWeave, the AI Hyperscaler, today announced that it is the first cloud provider to bring NVIDIA H200 Tensor Core GPUs to market. CoreWeave has a proven track record of being first to market with large-scale AI infrastructure, and was among the first to deliver a large-scale NVIDIA H100 Tensor Core GPU cluster interconnected with NVIDIA Quantum-2 InfiniBand networking, which broke MLPerf training records in June 2023. Today, CoreWeave's infrastructure services are used to train some of the largest and most ambitious models from customers including Cohere, Mistral, and NovelAI.
ROSELAND,新泽西,2024年8月28日/PRNewswire/-- CoreWeave,这家AI超大型规模公司今日宣布,它是第一家推出NVIDIA H200 Tensor Core GPU的云服务提供商 NVIDIA H200 Tensor Core GPU 到市场。CoreWeave已经证明是第一个推出大规模AI基础设施的公司,并且是最早交付了大规模NVIDIA H100 Tensor Core GPU集群互连的公司 NVIDIA H100 Tensor Core GPU GPU集群相连的 NVIDIA Quantum-2 InfiniBand gpu芯片-云计算 网络,于2023年6月打破了MLPerf训练记录。如今,CoreWeave的基础设施服务用于训练一些来自客户Cohere、Mistral和NovelAI的最大和最雄心勃勃的模型。
The NVIDIA H200 Tensor Core GPU is designed to push the boundaries of generative AI by providing 4.8 TB/s memory bandwidth and 141 GB GPU memory capacity that helps deliver up to 1.9X higher inference performance than H100 GPUs. CoreWeave's H200 instances combine NVIDIA H200 GPUs with Intel's fifth-generation Xeon CPUs (Emerald Rapids) and 3200Gbps of NVIDIA Quantum-2 InfiniBand networking, and are deployed in clusters with up to 42,000 GPUs and accelerated storage solutions to deliver powerful performance and enable customers to dramatically lower their time and cost to train their GenAI models.
NVIDIA H200 Tensor Core GPU旨在通过提供4.8 TB/s的内存带宽和141 Gb的GPU内存容量来突破生成式人工智能的界限,从而比H100 GPU实现高达1.9倍的推断性能。CoreWeave的H200实例将NVIDIA H200 GPU与英特尔第五代至强CPU(Emerald Rapids)和3200Gbps的NVIDIA Quantum-2 InfiniBand网络相结合,并部署在最多拥有42,000个GPU和加速存储解决方案的集群中,以提供强大的性能,并帮助客户大幅降低训练GenAI模型所需的时间和成本。
"CoreWeave is dedicated to pushing the boundaries of AI development and, through our long-standing collaboration with NVIDIA, is now first to market with high-performance, scalable, and resilient infrastructure with NVIDIA H200 GPUs," said Michael Intrator, CEO and co-founder of CoreWeave. "The combination of H200 GPUs with our technology empowers customers to tackle the most complex AI models with unprecedented efficiency, and to achieve new levels of performance."
“CoreWeave致力于推动人工智能发展的边界,并通过与NVIDIA长期合作,现在首个推出了具有NVIDIA H200 GPU的高性能、可扩展和弹性基础设施,” CoreWeave的首席执行官兼联合创始人迈克尔·因特拉特说。“H200 GPU与我们的技术相结合,赋予客户以前所未有的效率来应对最复杂的人工智能模型,并实现新的性能水平。”
CoreWeave's Mission Control platform offers customers unmatched reliability and resiliency by managing the complexities of AI infrastructure deployment and uptime with software automation. The platform helps customers train models faster and more efficiently by using advanced system validation processes, proactive fleet health-checking, and extensive monitoring capabilities. CoreWeave's rich suite of observability tools and services provides transparency across all the critical components of the system, empowering teams to maintain uninterrupted AI development pipelines. This translates to reduced system downtime, faster time to solution and lower total cost of ownership.
CoreWeave的Mission Control平台通过软件自动化管理AI基础设施的部署和可用性,为客户提供无与伦比的可靠性和弹性。该平台通过使用先进的系统验证流程、积极的车队健康检查和广泛的监控功能,帮助客户更快、更高效地训练模型。CoreWeave丰富的可观测工具套件和服务在整个系统的所有关键元件上提供透明度,帮助团队保持不间断的AI开发流水线。这意味着系统停机时间减少,解决方案的时间减少,总体拥有成本降低。
"CoreWeave has a proven track record of deploying NVIDIA technology rapidly and efficiently, ensuring that customers have the latest cutting-edge technology to train and run large language models for generative AI," said Ian Buck, vice president of Hyperscale and HPC at NVIDIA. "With NVLink and NVSwitch, as well as its increased memory capabilities, the H200 is designed to accelerate the most demanding AI tasks. When paired with the CoreWeave platform powered by Mission Control, the H200 provides customers with advanced AI infrastructure that will be the backbone of innovation across the industry."
CoreWeave有快速和高效地部署英伟达技术的可靠记录,确保客户拥有最新的先进技术来训练和运行大型语言模型以进行生成式人工智能。Ian Buck,英伟达超大规模和高性能计算副总裁表示:“通过使用NVLink和NVSwitch以及增加的内存能力,H200被设计用于加速最苛刻的人工智能任务。与由Mission Control提供支持的CoreWeave平台搭配使用,H200为客户提供了先进的人工智能基础设施,将成为行业创新的支柱。”
In addition to bringing the latest NVIDIA GPUs to market and advancing its portfolio of cloud services, CoreWeave is rapidly scaling its data center operations to keep up with demand for its industry-leading infrastructure services. CoreWeave has completed nine new data center builds since the beginning of 2024, with 11 more in progress. The company expects to end the year with 28 data centers globally, with an additional 10 new data centers planned in 2025.
除了将最新的英伟达GPU引入市场并推进其云服务组合之外,CoreWeave正在快速扩大其数据中心运营以满足其行业领先的基础设施服务需求。从2024年初至今,CoreWeave已完成了9个新的数据中心建设项目,另有11个正在进行中。该公司预计全球将拥有28个数据中心,并计划在2025年新增加10个新的数据中心。
About CoreWeave
CoreWeave, the AI Hyperscaler, delivers a cloud platform of cutting-edge software powering the next wave of AI. The company's technology provides enterprises and leading AI labs with the most performant and efficient cloud solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies and featured on Forbes Cloud 100 ranking in 2024. Learn more at .
关于CoreWeave
AI超级扩展器CoreWeave提供了一个以创新软件为基础的云平台,驱动着下一波人工智能的浪潮。该公司的技术为企业和领先的人工智能实验室提供了性能最佳且高效的云解决方案,用于加速计算。自2017年以来,CoreWeave在美国各地区以及欧洲建立起了不断扩大的数据中心网络。CoreWeave被评为TIME100最具影响力的公司之一,并于2024年入选了福布斯云100强排行榜。了解更多信息,请访问 .
SOURCE CoreWeave
消息来源:CoreWeave