Program and guest
20VC, hosted by Harry Stebbings, runs approximately 1 hour, 13 minutes and 26 seconds. The guest is Naveen Rao, founder and CEO of Unconventional AI, who previously founded Nervana Systems, co-founded MosaicML and later served as vice president of artificial intelligence at Databricks. This article covers Rao’s full conversation.
Key points
(The following paraphrases the guest’s views; timestamp links point to the corresponding positions in the original video.)
- Energy is the biggest bottleneck in AI infrastructure: building 1 gigawatt costs approximately 50 billion dollars, more than building a chip fabrication plant. Over the past few years, the industry has relied mainly on tapping unused grid capacity, and the difficulty of building genuinely new infrastructure has been underestimated. (https://www.youtube.com/watch?v=4UmFfI8CWuA&t=112s）
- The US grid has an average output of approximately 900 gigawatts and can reach 1.2 to 1.3 terawatts at peak; unused capacity is the portion currently available quickly. But the US has underinvested in energy infrastructure over the past 20 years, while China built out electricity capacity at approximately 6 times the US rate over the same period. (https://www.youtube.com/watch?v=4UmFfI8CWuA&t=167s）
- There is no ceiling on the inference market: AI models themselves could become a trillion-dollar market within a few years, and the inference market will reach 10 trillion dollars within 10 years; improving the efficiency of delivering a single token by an order of magnitude could expand the market 10-fold. (https://www.youtube.com/watch?v=4UmFfI8CWuA&t=3429s）
- Robotics will be 100 times larger than coding agents: intelligence has so far barely entered the physical world in any meaningful way, and most industrial robots merely execute predetermined programs. When billions of robots can dynamically solve physical problems, the cost of delivering physical labor such as cleaning and construction will fall sharply. (https://www.youtube.com/watch?v=4UmFfI8CWuA&t=3481s）
- Hardware is the area to bet on over the next 10 years: he dismisses the claim that “AI will destroy humanity,” arguing that demand is unlimited and hardware is the side worth betting on, while pure software investment is in an awkward position. (https://www.youtube.com/watch?v=4UmFfI8CWuA&t=2676s）
Background and notes
The subtitles cover the full video, approximately 1 hour, 13 minutes and 26 seconds, and this article covers Rao’s full conversation. The quotes in the opening montage are consistent with the main program, and all timestamps in the text refer to passages in the main program.