Article Complete
AIM
NVIDIA releases CUDA 12.0

NVIDIA releases CUDA 12.0

Discover the latest features of CUDA 12.0. Learn how to leverage architecture-specific improvements and boost your programming capabilities!

NVIDIA releases CUDA 12.0
Mohit Pandey·Published Updated

Key takeaways

  • NVIDIA's CUDA 12.0 update enhances programmability for the Hopper and Ada Lovelace architectures.
  • The update introduces improved CUDA dynamic parallelism APIs and CUDA Graphs API for better performance.
  • New features include support for GCC 12, C++20, and a nvJitLink library for JIT LTO.
  • Several tensor operations are now accessible via public PTX, improving computational capabilities.
5 min

NVIDIA announced the release of CUDA’s software toolkit update 12.0 that focuses on new programming models and accelerating processing capabilities through new hardware updates. 

The update allows users to target architecture-specific features in the NVIDIA Hopper and NVIDIA Ada Lovelace architectures with enhanced libraries, developer tools, and CUDA custom code. The new update also supports revamped CUDA dynamic parallelism APIs, enabling performance improvements and also enhancing CUDA Graphs API.

Moreover, the update also includes support for GCC 12 host compiler and C++20. The toolkit also has a new nvJitLink library for JIT LTO. With the new update, many tensor operations are now also available through public PTX like TMA bulk operations and 32x Ultra xMMA. 

https://www.youtube.com/watch?v=_5mnVGOxq50

Click here to check out the full release notes and here for the download links.

CUDA (Compute Unified Device Architecture) is NVIDIA’s parallel computing platform developed for general computing and is the lead framework for GPGPU. It is a software layer providing direct access to GPU’s virtual instruction set along with parallel computational elements for executing compute kernels.

In July, after the success of CUDA, NVIDIA announced the launch of their unified quantum computing platform, ‘QODA’ (Quantum optimised device architecture), for accelerating breakthroughs in quantum research and development in AI, HPC, and others.

Membership

Stay ahead with AI insights.

Unlimited access to premium articles, exclusive analysis, and the stories shaping India's AI economy.

Subscribe now

AIM Americas

1190 Miraloma Way Suite P, Sunnyvale, CA 94085

AIM India

1st Floor, Sakti Statesman, Bellandur, Bengaluru – 560103

© 2026 AIM. All rights reserved.