Article complete

NVIDIA Opens AI Factory Designs, Teams Up With Cisco on High-Speed Networking

The USFP optical module aims to increase network capacity, improve power efficiency and support larger AI infrastructure.

Modern building exterior with large glass panels, featuring a prominent NVIDIA logo at the entrance and landscaped surroundin

Key takeaways

  • NVIDIA and Cisco have introduced a new networking standard for AI data centres to enhance connectivity without expanding infrastructure.
  • The Ultra-Dense Small Form Factor Pluggable (USFP) module supports significantly higher bandwidth and power efficiency compared to existing optical modules.
  • This initiative is part of NVIDIA's broader strategy to promote open standards for AI infrastructure and improve data centre efficiency.
  • The USFP module addresses challenges of growing AI model demands by increasing data capacity while managing power consumption and costs.

Takeaways drafted with AI from the article text.

The companies unveiled the Ultra-Dense Small Form Factor Pluggable (USFP) module at the Open Compute Project (OCP) Global Summit in Santa Clara, California. USFP supports electrical signals of up to 400 gigabits per second (Gb/s) per lane. 

According to the companies, the technology offers four times the bandwidth density and around 1.3 times the power efficiency of existing 200 Gb/s-per-lane optical modules. NVIDIA and Cisco are developing the standard with TE Connectivity and Amphenol to support wider industry adoption.

The announcement forms part of NVIDIA’s wider push to expand open standards for AI infrastructure. At the summit, the company also contributed designs for its Vera Rubin rack and compute trays through its open MGX architecture.

As AI models grow and demand for AI inference increases, data centres must connect more computing systems while managing power consumption, costs and network complexity. Traditional expansion can require additional switches and optical links, increasing latency and energy use.

USFP aims to address these challenges by increasing the amount of data that networks can carry within the same physical footprint. The first planned modules will feature 16 full-duplex lanes in a design similar in size to the widely used Octal Small Form Factor Pluggable (OSFP) module. 

The companies plan to expand the design to 32 lanes or more.

The module can deliver up to 12.8 terabits per second (Tb/s) in total capacity. This could help AI infrastructure operators connect more computing resources without adding network layers or overhauling existing data centre infrastructure.

“Building the world’s largest AI factories starts with rethinking the smallest of connections,” said Gilad Shainer, Senior VP of Networking at NVIDIA.

He said companies were building an ecosystem to connect more computing systems more efficiently and support the next generation of AI factories.

NVIDIA also announced software components for managing AI infrastructure and worked with industry partners on standards for data centre design and power grid resilience. 

As for USFP, Cisco said the technology would allow AI infrastructure to scale without adding operational complexity. “It is designed to deliver a new level of bandwidth density while preserving the serviceability, deployment flexibility and operational simplicity of pluggable optics,” said Bill Gartner, Senior VP and GM of Optical Systems and Optics at Cisco.

The design also supports up to 100 watts of power dissipation without requiring a separate, dedicated cooling circuit within the transceiver. Its connector design aims to reduce contact wear and improve signal reliability.

NVIDIA and Cisco are working with TE Connectivity and Amphenol to develop the module’s cages, connectors and optical components. The companies plan to advance USFP through a community-led, multi-source project, allowing suppliers to develop compatible hardware.

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

data centres · 4 stories
  1. Meta Signs Up to $6 Bn Fibre Supply Deal With Corning
  2. Starcloud Reaches $1.1 Bn Valuation for its Data Centres in Space
  3. You are here: NVIDIA Opens AI Factory Designs, Teams Up With Cisco on High-Speed Networking
  4. Siemens Wants to Continue NVIDIA Partnership Even If Jensen Huang is Ousted
About the author

Technology Journalist

Covering deep and emerging tech: semiconductors, quantum, robotics, space tech, drones and GCCs. Connect via socials below or email:

All stories
Belamy · Daily

The day’s AI news, before your first meeting.