Fujitsu Develops Video Analytics AI Agent to Support Safe, Secure, and Efficient Frontline Workplaces
Fujitsu Develops Video Analytics AI Agent to Support Safe, Secure, and Efficient Frontline Workplaces
The AI agent will be evaluated by FieldWorkArena, an evaluation environment newly developed by Fujitsu, under the supervision of New technology achieves world-leading accuracy while significantly extending video duration processing capability
新技术实现了世界领先的准确性，同时显著延长了视频处理持续时间的能力
KAWASAKI, Japan, Dec. 12, 2024 /PRNewswire/ -- Fujitsu today announced the development of a video analytics AI agent for frontline workplaces. The AI agent uses spatial video and image data from workplace camera footage, as well as written information, to draft reports and make recommendations for workplace improvements. The AI agent will be positioned as a core technology of Fujitsu's AI service "Fujitsu Kozuchi". Fujitsu will provide a trial environment for the AI agent in fiscal year 2024 and commence in-house implementation from January 2025.
日本川崎，2024年12月12日 /PRNewswire/ -- 富士通今天宣布开发了一种面向前线工作场所的视频分析人工智能代理。该人工智能代理利用工作场所摄像头画面的空间视频和图像数据，以及书面信息，来起草报告并提出工作场所改进的建议。该人工智能代理将作为富士通人工智能服务"富士通Kozuchi"的核心技术。富士通将在2024财年提供该人工智能代理的试用环境，并从2025年1月开始实施内部使用。
The AI agent is based on a multimodal large language model (LLM). The AI agent trains itself to recognize 3D images of the workplace using information from written documentation (i.e., safety rules, etc). Context memory technology uses written information to selectively retain only the relevant data, enabling the analysis of long-duration video content with world-leading accuracy.
该人工智能代理基于多模态大型语言模型（LLM）。该人工智能代理通过书面文档（如安全规章等）中的信息训练自己识别工作场所的3D图像。上下文记忆技术利用书面信息选择性保留仅相关的数据，从而使以世界领先的准确性分析长时间的视频内容成为可能。
The AI agent will be evaluated by FieldWorkArena, an evaluation environment newly developed by Fujitsu, under the supervision of Carnegie Mellon University. FieldWorkArena will be made available for the researcher community from December 2024, with tasks being added to GitHub and the Fujitsu Research Portal in December 2024.
该人工智能代理将在富士通新开发的评估环境FieldWorkArena中进行评估，评估将在卡内基梅隆大学的监督下进行。FieldWorkArena将在2024年12月向研究社区提供，任务将于2024年12月添加到GitHub和富士通研究门户中。
Training to operate in the frontline workplace based on written documentation
基于书面文档的前线工作场所操作训练
This technology augments the AI agent's video data comprehension capabilities using information from written documentation to help the LLM understand what it cannot from video content alone.
该技术增强了人工智能代理的视频数据理解能力，利用书面文档中的信息帮助LLM理解其无法仅从视频内容中获得的信息。
Efficiently retaining context data from video content
高效保留视频内容中的上下文数据
This technology allows for the user to provide a prompt for a specific type of behavior to focus on in a video, i.e., "safe behavior in humans."
该技术允许用户提供关于视频中特定类型行为的提示，即"人类的安全行为。"
FieldWorkArena
实地工作领域
Under the supervision of Carnegie Mellon University's Associate Professor Graham Neubig and Assistant Professor Yonatan Bisk, Fujitsu has developed the FieldWorkArena, an evaluation environment for its video analytics AI agent service. The FieldWorkArena includes a bank of images and video content from actual frontline workplaces including plants and warehouses, documents such as rules and instruction manuals, simulations of business systems, and sets of tasks for the AI agent to solve.
在卡内基梅隆大学副教授Graham Neubig和助理教授Yonatan Bisk的指导下，富士通开发了FieldWorkArena，这是其视频分析人工智能代理服务的评估环境。FieldWorkArena包含来自实际前线工作场所（例如工厂和仓库）的图像和视频内容的资源库，规则和操作手册等文档，业务系统的模拟，以及AI代理需要解决的一系列任务。
For full release click here
点击这里查看完整发布
SOURCE Fujitsu Limited
来源 富士通有限公司