John Carmack's Laser-Powered AI Cache: A Revolutionary Idea for Data Streaming

John Carmack, the visionary programmer, is exploring an exciting alternative to traditional DRAM for AI data streaming! He envisions a long fiber optic line acting as an L2 cache, potentially leveraging incredible bandwidth and near-zero latency for AI model weight access. This innovative approach could dramatically enhance AI performance.

• •John Carmack is exploring using a fiber optic line as an L2 cache.
• •The concept aims for near-zero latency for AI model weight access.
• •Single mode fiber speeds have reached 256 Tb/s over 200 km.