Lex Fridman Podcast Features Jensen Huang on NVIDIA's AI Infrastructure

Lex Fridman

Mar 24, 2026 · Updated Apr 25, 2026

Lex Fridman's latest podcast episode digs into NVIDIA's role as the backbone of the AI revolution with CEO Jensen Huang, covering GPU computing and infrastructure scaling. Huang walks through how NVIDIA thinks about rack-scale co-design, agentic AI scaling, and the supply chain challenges shaping the next generation of AI data centers.

Jensen Huang, CEO of NVIDIA, joined Lex Fridman for a wide-ranging conversation on the infrastructure powering the AI revolution. Huang walked through how NVIDIA's GPU architecture has become the foundation for training and deploying large AI models at scale, from data center design to the software ecosystems supporting AI workloads.

The conversation covers why GPU compute has overtaken traditional CPU-based approaches for AI workloads, including the parallel processing advantages that make modern AI models commercially viable. Huang discusses NVIDIA's strategic positioning around rack-scale engineering, its relationship with TSMC, and how the company thinks about long-term infrastructure bets across silicon, networking, and power delivery.

Huang also gets into agentic AI scaling as the next frontier beyond pre-training and post-training, what NVIDIA's moat looks like when everyone's building AI factories, and his take on AGI timelines and the future of programming — worth watching if you're tracking where AI infrastructure investment is heading.

View the full update on lexfridman.com

Lex Fridman

@lexfridmanMar 23

Here's my conversation with Jensen Huang, CEO of NVIDIA, the most valuable & one of the most influential companies in the history of human civilization. It is the engine powering the AI revolution. This was a fascinating & inspiring conversation, in parts super-technical on https://t.co/RJ6aOgHY4O

714

View on X

Every HeadsUpAI update is written based on its original source and reviewed before it's published. Read our editorial standards →

Keep reading

NVIDIA CEO Jensen Huang Outlines Five-Layer Strategy for AI Leadership

Jensen Huang introduced the five-layer AI cake framework to define national AI leadership across energy, chips, infrastructure, models, and applications. He noted that the industry is shifting toward inference-time compute where models use more processing power to think through complex problems.

Fireworks AIMay 29

Fireworks AI earns NVIDIA CEO Jensen Huang endorsement as AI foundry

NVIDIA CEO Jensen Huang characterized Fireworks AI as the TSMC of AI factories, highlighting the company's specialized role in the inference stack. This endorsement signals a shift where high-performance inference providers are becoming the essential foundries for the generative AI era.

Qwen Sets 580 TPS Record for Agentic Workloads on Blackwell GPUs

QwenMay 27

Qwen Sets 580 TPS Record for Agentic Workloads on Blackwell GPUs

Qwen achieved a record 580 tokens per second running its Qwen3.5-397B-A17B model on NVIDIA Blackwell GPUs using the TokenSpeed inference engine. The optimization targets agentic workloads, where multi-turn reasoning and tool-calling typically suffer from high latency. By combining a hybrid attention architecture with deep kernel fusion, the system maintains high throughput even as context scales to one million tokens.

OpenAI Raises $110B From SoftBank, NVIDIA, and Amazon to Scale AI Infrastructure

OpenAIFeb 27

OpenAI Raises $110B From SoftBank, NVIDIA, and Amazon to Scale AI Infrastructure

OpenAI raised $110B from SoftBank, NVIDIA, and Amazon at a $730B valuation. The deal goes beyond capital — strategic partnerships lock in dedicated NVIDIA inference capacity and Amazon enterprise distribution through AWS.