- Published on November 2, 2021
- In Global Tech
Kiss Me, Transformer – A Journey of OpenAI
Other large scale transformer models include EleutherAI GPT-J, BAAI's Wu Dao 2.0, Google's Switch Transformer, and NVIDIA-Microsoft’s MT-NLG.
- By Amit Naik
In little less than five years, OpenAI has become one of the leading AI research labs globally, alongside other AI players like Alphabet's DeepMind, EleutherAI and SambaNova Systems. Its love for transformers is never-ending and indescribable.
OpenAI has been making headlines (for both right and wrong reasons) for its research work, particularly in the area of transformers, unsupervised, transfer learning, and the most obvious, GPT-3, or generative pre-trained transformer 3.
The Genesis
Two years ago, OpenAI published a blog post and paper on GPT-2. It was created as a direct scale-up of the 2018 GPT model. That changed everything for the company, where it released a small parameter (124 million) GPT-2 model in February 2019, followed by a staged/phased release o
📣 Want to advertise in AIM? Book here
Amit Naik
Amit Raja Naik, known as the 'AI Human,' serves as the editor at AIM Media House, where he leads a team of talented tech journalists who are driving and shaping technology conversations across India and around the world.
Related Posts
Indian Developers Fear They Aren’t Coding Enough Anymore
“Whatever coding you had to learn you learnt in college. Now is the time to build and ship.”
Decoding India’s New Labour Codes
The new labour codes realign wages, tighten compliance, expand social security, and reshape hiring and layoff norms.
AI Redefining Compliance Verification for India’s Gig Economy
For many Indian companies, hiring entry-level staff is simpler than paying for AI tools for employee background checks.
Why Data Governance Has Become India’s New AI Imperative
Data governance takes centre stage as AI becomes critical for deployment across businesses.
India’s New Courtroom Menace: Judgments That Never Existed
AI-hallucinated citations are pushing judges, lawyers and tribunals to tighten verification before fiction becomes legal fact.
The Need For The 10× IT Admin
System admins are burdened with manual, repetitive recovery work — a gap AI may be able to reduce.
How Governance, Compute and Digital Rails Will Redefine BFSI
“We should see the uncertainty around AI in front-line workflows increase, as the uncertainty around compliance goes down.”
How Nimaya is Preparing Women to Lead in AI
Upskilling women, especially those from non-metro regions, does more than diversify the talent pool.
Download the easiest way to
stay informed
stay informed
