As enterprises adopt AI, one tension has become clear: inference needs to be centralized for efficiency, governance, and reliability, while use cases and model development are necessarily decentralized across teams. Without the right architecture, this leads to fragmented deployments, rising costs, and governance blind spots.
A pattern that has become more common is the use of AI Gateways, an evolution of the API gateway. In this talk, we’ll explore the AI Gateway pattern - an architectural approach that provides a single control point for inference while enabling decentralized teams to innovate at speed.
We’ll cover the trade-offs and best practices while working through a real life before/after use case of a Financial services firm. This talk will leave the audience with practical tips, and will point towards relevant open source technologies to explore to unlock scale, reduce duplication, and deliver both governance and agility.
Speaker
Meryem Arik
Co-Founder and CEO @Doubleword (Previously TitanML), Recognized as a Technology Leader in Forbes 30 Under 30, Recovering Physicist
Meryem is the Co-founder and CEO of Doubleword (previously TitanML), a self-hosted AI inference platform empowering enterprise teams to deploy domain-specific or custom models in their private environment. An alumna of Oxford University, Meryem studied Theoretical Physics and Philosophy. She frequently speaks at leading conferences, including TEDx and QCon, sharing insights on inference technology and enterprise AI. Meryem has been recognized as a Forbes 30 Under 30 honoree for her contributions to the AI field.
