Deep dives into the foundational hardware and infrastructure powering AI, including GPU advancements, specialized processors like TPUs, and the history and future of AI computing. This topic features insights from industry leaders like Jensen Huang and the role of companies like NVIDIA.
TPU's origin story
Low-latency AI inference
Data movement's true cost
“The big lesson is that for me is technology is changing all the time, and so long as you're able to confront the reality, so long as you are able to learn, the technology itself actually doesn't matter.”
“Look for something where the model succeeds 0% or 1% of the time, not 20%.”
Jensen Huang, the visionary CEO of NVIDIA, offers a rare glimpse into the company's tumultuous beginnings, revealing how a fundamental misstep in technology choice nearly ended their journey before it began. His candid reflections provide invaluable lessons on adaptability, the power of a unique perspective, and the relentless pursuit of innovation that transformed NVIDIA into a trillion-dollar AI giant.
In a captivating session, Google's AI luminary Jeff Dean offered a profound look into the current state and future trajectory of artificial intelligence. From bold predictions about AI's evolving capabilities to the foundational hardware shifts driving innovation, Dean provided invaluable insights for engineers and aspiring founders alike. He emphasized the critical role of 'napkin math' in identifying bottlenecks and the strategic importance of 'taste' in problem selection.