08-30-2026, 04:50 PM
From Open Models to Open AI Infrastructure
Authors: Mallik Tatipamula and Vinton G. Cerf
Published: August 26, 2026, The Official ACM / Communications of the ACM
The article argues that open AI models alone are not enough to democratize artificial intelligence. Even when model weights are freely available, training, fine-tuning, and large-scale inference increasingly depend on expensive GPUs and accelerators, large memory systems, high-performance storage, fast networks, and sophisticated orchestration software. These resources remain concentrated in a relatively small number of companies and institutions. The authors compare this situation to giving everyone electrical appliances while only a few people have access to electricity: in the AI era, compute is becoming the “electricity of intelligence.”
Tatipamula and Cerf therefore propose moving from the idea of open models toward Open AI Infrastructure: an architectural framework in which open models, compute, memory, networking, storage, runtime systems, and orchestration can work together through interoperable standards. Their argument is strongly influenced by the history of the Internet and Linux. Linux succeeded not simply because its source code was open, but because it could run on inexpensive commodity hardware and communicate through open Internet standards. Likewise, AI will become broadly accessible only when both the software and the infrastructure required to run it become accessible and interoperable.
The key engineering idea is to treat AI infrastructure as a system of systems rather than optimizing GPUs, networks, storage, or models independently. Large AI workloads increasingly span clusters, cloud systems, edge devices, and enterprise data centers, so performance depends on how all these components interact. Many pieces already exist—open models, Open Compute initiatives, open networking technologies, and open software frameworks—but they have largely evolved separately. The authors see the next major step as integrating these components into a common, vendor-neutral distributed AI execution fabric, allowing organizations to combine heterogeneous hardware, models, and software rather than depending on a single vertically integrated provider.
Key takeaways
ARTICLE
Authors: Mallik Tatipamula and Vinton G. Cerf
Published: August 26, 2026, The Official ACM / Communications of the ACM
The article argues that open AI models alone are not enough to democratize artificial intelligence. Even when model weights are freely available, training, fine-tuning, and large-scale inference increasingly depend on expensive GPUs and accelerators, large memory systems, high-performance storage, fast networks, and sophisticated orchestration software. These resources remain concentrated in a relatively small number of companies and institutions. The authors compare this situation to giving everyone electrical appliances while only a few people have access to electricity: in the AI era, compute is becoming the “electricity of intelligence.”
Tatipamula and Cerf therefore propose moving from the idea of open models toward Open AI Infrastructure: an architectural framework in which open models, compute, memory, networking, storage, runtime systems, and orchestration can work together through interoperable standards. Their argument is strongly influenced by the history of the Internet and Linux. Linux succeeded not simply because its source code was open, but because it could run on inexpensive commodity hardware and communicate through open Internet standards. Likewise, AI will become broadly accessible only when both the software and the infrastructure required to run it become accessible and interoperable.
The key engineering idea is to treat AI infrastructure as a system of systems rather than optimizing GPUs, networks, storage, or models independently. Large AI workloads increasingly span clusters, cloud systems, edge devices, and enterprise data centers, so performance depends on how all these components interact. Many pieces already exist—open models, Open Compute initiatives, open networking technologies, and open software frameworks—but they have largely evolved separately. The authors see the next major step as integrating these components into a common, vendor-neutral distributed AI execution fabric, allowing organizations to combine heterogeneous hardware, models, and software rather than depending on a single vertically integrated provider.
Key takeaways
- Open models ≠ fully open AI. Access to the underlying computing infrastructure is becoming just as important as access to model weights.
- AI needs an Internet-like architecture: interoperable standards that allow independently developed models, hardware, networks, storage, and software to work together.
- System-level optimization matters more than isolated improvements. GPU performance alone means little if memory bandwidth, networking, storage, or orchestration become bottlenecks.
- The authors' central distinction is: open models democratize access to intelligence; open AI infrastructure could democratize participation in building and deploying AI.
ARTICLE
┌────────────────────────────────┐
│ KONSTANTINOS MICHAILIDIS │
└────────────────────────────────┘
│ KONSTANTINOS MICHAILIDIS │
└────────────────────────────────┘