World’s First 7nm GPU Is Here And The AI World Will Never Be The Same

It occupied more than 1,900 sq ft, needed about 18,000 vacuum tubes to work and the total weight of the machine was almost 50 tons. This is the description of the world’s first digital computer. John Mauchly and J Presper Eckert invented the machine known popularly known as ENIAC at the University Of Pennsylvania and completed the construction by 1946.

The modern world has seen an explosion in the research for shrinking the size of these devices, and as a result, our computers are becoming smaller and smaller. After the CPUs, the world saw the advent of GPUs which were a little dumber than CPUs but could do calculations very well. These GPUs found a huge demand for machine learning and AI making it desirable to shrink these kinds of chips.

AIM Daily XO

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

Recently, AMD created an uproar in the industry after they announced the world’s first 7nm GPU named Radeon Instinct MI60 at its Next Horizon conference. The new GPU also has an industry leading 1TB/sec of memory bandwidth.

AMD’s Ace Card

In a press statement, AMD said that they believed the GPU will power the next generation of deep learning and AI applications with additional applications in High Performance Computing (HPC), cloud computing and graphical rendering applications. AMD is also expecting wide-ranging acceptance of the GPU among researchers and scientists working on climate sciences and computational biology.

Download our Mobile App

In the statement, David Wang, Senior Vice President of Engineering, Radeon Technologies Group at AMD said, “Legacy GPU architectures limit IT managers from effectively addressing the constantly evolving demands of processing and analyzing huge datasets for modern cloud data centre workloads. Combining world-class performance and a flexible architecture with a robust software platform and the industry’s leading-edge ROCm open software ecosystem, the new AMD Radeon Instinct accelerators provide the critical components needed to solve the most difficult cloud computing challenges today and into the future.”

As we wrote before the era of “CPU for all tasks” has long ended. GPU based computing became very important to many companies who were planning to have special kind of computation mechanisms. GPU nowadays are almost designed to work in ML applications where billions and billions of parameters need to be computed.

Technology Behind Radeon Instinct MI60

Since they are built for the world of deep learning the AMD Radeon Instinct MI60 and MI50 chips have an ability for ultra-fast floating point computing performance and can communicate effectively with a speed up to 1TB/s memory bandwidth speeds. The company says that the GPU to GPU communication has also considerably increased and now is about 6X faster than before. This is enabled by the special AMD Infinity Fabric Link technology.

AMD has specifically designed the chips for high scale operations for companies like Google. They are also announcing the new ROCm open software platform for accelerated computing and Google appreciates the change of attitude by AMD. Rajat Monga, engineering director, TensorFlow, Google said, “We’ve seen how helpful it can be to open source machine learning technology, and we’re glad to see AMD embracing it. With the ROCm open software platform, TensorFlow users will benefit from GPU acceleration and a more robust open source machine learning ecosystem.”

The 7nm technology by AMD also claims to dramatically improves performance per watt over previous generation products. The special distinction about the chip is that it is the world fastest double precision accelerator which means it can do calculations with bigger numbers faster than any computer in the world. It can deliver upto 7.4 TFLOPS directly and a little less when using it via the cloud.

Competition And Chips

AMD faces tough competition from rival chip makers like Intel, NVIDIA and others. Recently Intel responded to a direct competition scare by AMD by launching a new class of Xeon Scalable processors that bettered many performances benchmarks set by AMD. The project code-named Cascade Lake-AP processors had 48 cores and support for 12 channels of DDR4 RAM memory which is much more better than AMD’s Epyc server processors.

There is also a lot of buzz on how AMD will respond to the ray tracing technology introduced by NVIDIA. AMD has not yet planned any such announcements and no announcements were made at the New Horizons event where 7nm GPUs were released. AMD said that they will enter into the ray tracing technology sometimes but stated, “Utilisation of ray tracing games will not proceed unless we can offer ray tracing in all product ranges from low end to high end.”

The main game is about improving speeds in internal computation communications and how much payoff or improvement does a technology or innovation makes. Ray tracing technology does not seem to make such promised currently compared to the introduction of the 7nm chip from AMD. There are also rumours about how NVIDIA may respond to the market move by AMD and what the reaction will be.

The buzz created by the launch of the new 7nm GPU and the coming market moves by the competition may change the game of AI forever.

Sign up for The Deep Learning Podcast

by Vijayalakshmi Anandan

The Deep Learning Curve is a technology-based podcast hosted by Vijayalakshmi Anandan - Video Presenter and Podcaster at Analytics India Magazine. This podcast is the narrator's journey of curiosity and discovery in the world of technology.

Abhijeet Katte
As a thorough data geek, most of Abhijeet's day is spent in building and writing about intelligent systems. He also has deep interests in philosophy, economics and literature.

Our Upcoming Events

24th Mar, 2023 | Webinar
Women-in-Tech: Are you ready for the Techade

27-28th Apr, 2023 I Bangalore
Data Engineering Summit (DES) 2023

23 Jun, 2023 | Bangalore
MachineCon India 2023 [AI100 Awards]

21 Jul, 2023 | New York
MachineCon USA 2023 [AI100 Awards]

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox

Council Post: The Rise of Generative AI and Living Content

In this era of content, the use of technology, such as AI and data analytics, is becoming increasingly important as it can help content creators personalise their content, improve its quality, and reach their target audience with greater efficacy. AI writing has arrived and is here to stay. Once we overcome the initial need to cling to our conventional methods, we can begin to be more receptive to the tremendous opportunities that these technologies present.