The show and guest
An interview on 20VC with Erik Bernhardsson, co-founder and CEO of AI infrastructure company Modal. Original English title: Modal CEO: Who Wins the Inference Market | What Happens to the Cost of Compute.
Key takeaways
- The inference market could produce companies worth tens of billions of dollars, driven by a range of specialized models: there will be a pullback in the short term, but the long-term opportunity is enormous, and he is not worried about it 0:00
- Modal has surpassed 1 billion dollars in annual revenue and just completed a 750 million-dollar Series D at a valuation of 15.75 billion dollars; this episode examines where the inference market is heading 0:21
- Inference will become a huge new market, a “new cloud,” but inference alone is not enough: a complete suite of products is also needed, including post-training, sandboxes, agentic capabilities, low-latency inference and batch inference 11:57
- This product suite is not easy to build: the team has already spent five years on it, and infrastructure itself is a difficult product, creating a strong barrier to entry 12:24
Background and notes
Subtitle coverage: The video subtitles contain 2041 timestamped segments, covering 0:00–1:02:04 (full length 1:02:12); this article presents the main points from the full 1:02:12 interview. The views and timestamps are paraphrased from the original subtitles, and each timestamp marks the start of the segment containing the corresponding remarks.