- Published on June 27, 2024
- In Global Tech
Etched Takes a Risky Bet on Transformers to Topple NVIDIA
One 8xSohu server replaces 160 H100s.
Image by Diksha Mishra
- By Siddharth Jindal
AI hardware company Etched has unveiled Sohu, the first specialised chip (ASIC) built exclusively for Transformer models. Today, every major AI product (ChatGPT, Claude, Gemini, Sora) is powered by Transformers and the company believes that within a few years, every large AI model will run on custom chips.
“An accelerator from NVIDIA or Google is flexible. It can be programmed to run many different kinds of AI models, like convolutional networks, TMAs, or Transformers. Our chips are different. They are only able to run this one very narrow class of model, which we call Transformers,” said co-founder and CEO Gavin Uberti.
Etched claims that Sohu can process over 500,000 tokens per second with Llama 70B. One 8xSohu server replaces 160 H100s. According to the company, “Sohu is mor
📣 Want to advertise in AIM? Book here
Siddharth Jindal
Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.
Related Posts
Fighting Deepfakes May Not Be a Technology Problem
Defenders must be active at all times, while attackers need only one opportunity.
India’s Data Centre Expansion Is Decentralising
Without compute buildup beyond metros, the next wave of digital adoption will be constrained
How Mumbai Keeps Winning India’s Data-Centre Race
Land prices are among the highest in the country, but total build economics remain competitive by global standards.
From Shortages to Scale, io.net’s Approach to Rewriting AI Compute Access
A decentralised GPU marketplace may scale AI compute faster than traditional clouds, as GPU demand towers over supply
Why Deloitte Built a Tax AI That Knows When to Say ‘I Don’t Know’
The company has launched an agentic AI platform for tax research that’s targeting something radical in a conservative profession.
Can India’s AI Copyright Plan Survive Legal and Technical Scrutiny?
India’s ambitious proposal for a single mandatory AI training licence faces feasibility, legal and innovation concerns.
2026 Could be India’s Year in AI, But Only the Resilient Will Survive
“This isn’t a freeze. It’s a filter… By 2026, the real signal will be resilience, not rhetoric.”
Enterprises Won’t Choose Sovereign Models For Patriotism’s Sake
The first set of sovereign models is aimed at Indic languages and national datasets. Their value lies in cultural nuance.
Download the easiest way to
stay informed
stay informed
