Nvidia Corp. (NASDAQ:NVDA) rival Groq announced on Tuesday that it will deploy AI in Saudi Arabia in 2024, in partnership with Aramco Digital, at the ongoing Global AI Summit (GAIN) in Riyadh, Saudi Arabia.
What Happened: Jonathan Ross, founder and CEO of Groq, made the announcement at the GAIN summit alongside Tareq Amin, CEO of Aramco Digital, a subsidiary of Saudi Aramco.
Making the announcement, Ross revealed that Groq will achieve a capacity of 25 million tokens per second by the end of Q1 2025. He added that this is equivalent to Microsoft Corp. and OpenAI's combined capacity at the end of 2023.
Tokens are, simply put, a fundamental unit of data processing as far as AI models are concerned. Tokens may consist of words, characters, or phrases.
Subscribe to the Benzinga Tech Trends newsletter to get all the latest tech developments delivered to your inbox.
A higher token capacity allows for faster response times, and Groq says it now has the fastest output speed.
More speed on our existing 14nm silicon.
— sunny madra (@sundeep) September 10, 2024
GA soon.
Reach out if you want to go fast! pic.twitter.com/nmgKusqxYC
Ross also said this capacity can be expanded to 1 billion tokens per second, consuming over 600 megawatts of power.
Google Underscores Importance Of Empowering Users With Fact Check Tools Amid Rising Use Of AI
Why It Matters: Groq is one of the rivals of Nvidia, the current leader in the AI industry. The AI startup revealed that over 444,000 developers around the world use the Groq API, or application programming interface – by this metric, it says it is now the world's second-largest AI company.
Aramco Digital also announced a custom operating system based on AI, called NourOS. This operating system allows users to talk to the system in natural language, for everything from querying information to setting up new processes.
Grok was recently reported to be close to a new funding round led by BlackRock Inc., doubling the company's valuation to $2.5 billion.
The AI startup has also been endorsed by former Facebook executive, Chamath Palihapitiya, who advised developers to use Groq's AI models to enhance their applications.
Check out more of Benzinga's Consumer Tech coverage by following this link.
- Dean Of Valuation Aswath Damodaran Shares 3 Ways To Beat The Bot And Safeguard Your Job From AI
Photo courtesy: Rounak Jain/Benzinga
