Discussion about this post

User's avatar
Maryann's avatar

Excellent article Devansh. What stands out to me is how this isn’t just capital consolidation but cognitive consolidation. Once CUDA becomes the default mental model for compute, the monopoly extends far beyond hardware. The next fault line may not be chips, but energy and memory bandwidth. I think whoever cracks those constraints will shape the next architecture cycle. Keen to hear your thoughts. Once again, great article. Got me thinking!

Expand full comment
John Michael Thomas's avatar

You outdid yourself on this one Devansh - really excellent.

I may be completely off here, but the only way I can see an alternative commercial architecture gaining traction is if someone like AWS (and honestly, probably only AWS) puts their weight behind it - like they did with Graviton.

The migration with AI compute is more complex than the move to Graviton was, but with Amazon's scale, the payoff could potentially be huge for them even with relatively small cost savings from an alternative architecture. And it would also give AWS something that might be even more valuable to them long-term than the cost savings - lack of dependence on NVIDIA.

The other potential disruptor here is China. AI tech export restrictions are already pushing them to develop alternatives, and I only expect it to continue. Even with the NVIDIA sales carve-out, China is highly allergic to dependence on NVIDIA (or any non-Chinese company), and they're likely very willing to pour national resources into it. So, I expect they'll eventually have their own alternative, and to push it internationally once they do. But I have no idea how long that will take.

Expand full comment
49 more comments...

No posts

Ready for more?