Amazon Launches Trainium2 Instances for Improved AI Model Training
Amazon Launches Trainium2 Instances for Improved AI Model Training
TMTPOST — Amazon announced the public launch of its new AWS Trainium2-powered Amazon Elastic Compute Cloud (EC2) instances at the AWS re:Invent conference. These GPU-based instances promise a significant 30-40% improvement in price-to-performance ratio compared to current offerings, according to a statement from Amazon.
TMTPost——亚马逊在AWS re: Invent会议上宣布公开发布其基于AWS Trainium2的新款亚马逊弹性计算云(EC2)实例。根据亚马逊的一份声明,与目前的产品相比,这些基于GPU的实例有望显著提高30-40%的性价比。
Along with the new Trainium2 EC2 instances, AWS introduced its next-generation Trainium3 AI processors, designed to enhance performance and efficiency in future AI deployments. AWS also revealed Trn2 UltraServers, which are intended to support large-scale AI workloads.
除了新的Trainium2 EC2实例外,AWS还推出了其下一代Trainium3人工智能处理器,旨在提高未来人工智能部署的性能和效率。AWS还透露了旨在支持大规模人工智能工作负载的Trn2 UltraServers。
The Trainium2 instances, which feature 16 Trainium2 processors, deliver 20.8 peak petaflops of computational power, making them ideal for training and deploying generative artificial intelligence projects, especially large language models. To further enhance these capabilities, the newly launched Trn2 UltraServers connect 64 Trainium2 processors via the ultra-fast NeuronLink interface, boosting processing capacity to up to 83.2 peak petaflops. This configuration aims to accelerate AI model training times and enable real-time inference for models with trillions of parameters.
Trainium2 实例采用 16 个 Trainium2 处理器,可提供 20.8 千亿次浮点运算的峰值计算能力,非常适合训练和部署生成式人工智能项目,尤其是大型语言模型。为了进一步增强这些功能,新推出的Trn2 UltraServers通过超快的NeuronLink接口连接了64个Trainium2处理器,将处理能力提高到高达83.2的峰值千亿次浮点。此配置旨在加快 AI 模型的训练时间,并为具有数万亿个参数的模型提供实时推理。
Amazon also unveiled a suite of artificial intelligence models, marking its strongest push yet to compete with tech giants in the rapidly expanding generative AI market.
亚马逊还推出了一套人工智能模型,这标志着其迄今为止在快速扩张的生成式人工智能市场中与科技巨头竞争的最大推动力。
Rohit Prasad, Amazon's senior vice president overseeing the company's AI initiatives, explained, "Inside Amazon, we have about 1,000 Gen AI applications in motion, and we've had a bird's-eye view of what application builders are still grappling with. Our new Amazon Nova models are intended to help with these challenges."
负责监督该公司人工智能计划的亚马逊高级副总裁罗希特·普拉萨德解释说:“在亚马逊内部,我们有大约1,000代人工智能应用程序正在运行,而且我们已经鸟瞰了应用程序开发者仍在努力解决的问题。我们的新亚马逊 Nova 机型旨在帮助应对这些挑战。”
The Nova family includes six AI models designed to handle tasks ranging from text creation to video generation. Amazon claims the models are at least 75% more affordable than comparable offerings available on AWS servers, with improved processing speeds.
Nova 系列包括六个 AI 模型,旨在处理从文本创建到视频生成的各种任务。亚马逊声称,这些模型比AWS服务器上可用的同类产品便宜至少75%,处理速度也有所提高。
The lineup includes Nova Micro for fast text processing, Nova Lite for basic multimedia tasks, and Nova Premiere, scheduled for release in early 2025, for more complex reasoning. The models support 200 languages and offer customization options using customers' proprietary data, a feature Amazon hopes will attract enterprises seeking specialized AI applications.
该阵容包括用于快速文本处理的Nova Micro、用于基本多媒体任务的Nova Lite以及计划于2025年初发布的用于更复杂推理的Nova Premiere。这些模型支持200种语言,并使用客户的专有数据提供自定义选项,亚马逊希望这一功能将吸引寻求专业人工智能应用程序的企业。
Rohit Prasad, Amazon's head of artificial general intelligence, emphasized that the company would compete with rivals on both price and capabilities, showcasing the faster speeds of its new models. He noted that "if I have something better to offer, then customers will come and use it," underscoring Amazon's potential to lead in AI as the field continues to evolve.
亚马逊人工智能负责人罗希特·普拉萨德强调,该公司将在价格和功能上与竞争对手竞争,展示其新机型更快的速度。他指出,“如果我有更好的东西可以提供,那么客户就会来使用它”,这突显了随着人工智能领域的不断发展,亚马逊在人工智能领域处于领先地位的潜力。
A particularly exciting development is the Nova Reel software, which allows users to generate six-second videos from a single image or text prompt, ideal for product displays on Amazon's website. The tool will soon be expanded to support videos up to two minutes long. The entertainment industry has shown keen interest in these AI tools to enhance filmmaking capabilities, although concerns about potential copyright infringement remain.
一项特别令人兴奋的开发是Nova Reel软件,它允许用户根据单个图像或文本提示生成六秒钟的视频,非常适合在亚马逊网站上展示产品。该工具将很快扩展到支持长达两分钟的视频。尽管对潜在版权侵权的担忧仍然存在,但娱乐业对这些用于增强电影制作能力的人工智能工具表现出了浓厚的兴趣。
Amazon also introduced Canvas, an image-generation tool powered by short text prompts, and committed to using watermarking technology to ensure responsible usage and prevent the spread of harmful content.
亚马逊还推出了Canvas,这是一款由短文本提示提供支持的图像生成工具,并承诺使用水印技术来确保负责任地使用并防止有害内容的传播。
Other offerings include advancements to accelerate the processing and analysis of text, and Amazon's upcoming AI model that will support text, images, speech, and video input, allowing for the generation of any of these outputs.
其他产品包括加速文本处理和分析的进步,以及亚马逊即将推出的人工智能模型,该模型将支持文本、图像、语音和视频输入,允许生成任何这些输出。