Health

Open Supply AI Platform Engineering

Advertisement

Each November, Lisbon turns into the capital of tech with Internet Summit. The occasion covers all the things from cybersecurity and power to builders, coverage, well being, and (after all!) AI. College students, journalists, buyers, CEOs, and founders on the lookout for funding all find yourself in the identical hallways.

I used to be there representing Cisco with a session referred to as “Democratising AI Platform Engineering with Open Supply”. My aim was to discover what AI platform engineering is, why it issues no matter you utilize your brokers for, and the way open supply can get you there.

AI Platform Engineering, the Open Supply Method

In order for you AI brokers to be an actual a part of your Monday, working facet by facet together with your group, you want some strong foundations: authentication, authorization, observability, and many extra, so your brokers, instruments, and expertise run responsibly. You’ve three choices:

  1. Construct it your self (or vibe code it), and personal the plumbing and upkeep.
  2. Pay for a black field you’ll be able to’t change.
  3. Undertake a mature open-source undertaking with the plumbing prepared and the batteries included.

My session was all about possibility three.

Advertisement

CAIPE (pronounced “cape”) is a CNCF Sandbox undertaking: an open-source AI platform that helps groups construct, govern, and function safe AI brokers and workflows. It brings authentication, authorization, MCP instruments, RAG, and workflows collectively underneath a single pane of glass (WebUI, APIs, Slack, Webex, and extra). You deploy it your manner (variety, Helm, Docker Compose) and tinker at will.

My favourite half is that each part is FOSS and swappable. Swap the default Keycloak for the Duo you already use, deliver your LLM of alternative, or index your data from Confluence, Slack, or any URL right into a RAG constructed on the included Neo4j.

There isn’t a silver bullet, after all. Each group has completely different wants and trade-offs. However a undertaking like this provides you a head begin, and contributions from folks within the trenches make it higher for everybody.

Speaking to AI Leaders

The Monday earlier than Internet Summit, I used to be invited to the AI Engineering Night time for Leaders in Tech by AI Builders. The viewers was principally founders, CEOs, and CTOs of startups and mid-size tech firms. As an engineer and Developer Advocate, I needed to change gears and speak their language: how open supply can deliver worth to your group, beginning with the naked minimal and scaling on the tempo of your organization.

Enter Storm Charles

Internet Summit’s second day was canceled! Storm Charles was heading straight for Lisbon, so an emergency state was declared and non-essential enterprise (Internet Summit included) shut down. Charles got here and went, the town held up, and the subsequent day was the massive one for my masterclass.

I had 45 minutes and 111 attendees in a room constructed for 100, and I liked each minute: the power, the vibe, the follow-up conversations. The weeks of preparation had been price it.

In Conclusion

If you wish to deliver AI brokers to your setting the correct manner, give open supply an opportunity. CAIPE is a sturdy various to constructing and sustaining all the things your self, or counting on proprietary companies.

One trustworthy caveat: open supply isn’t free. You pay in a unique foreign money. The tinkering is on you and the help comes from the neighborhood, however so does the roadmap, and in the end the profit is shared by everybody.

Sidenote: File Your Demos!

I’m a real believer in reside demos. I really like the adrenaline. However they’ll chew again. Halfway by my demo on the AI Builders occasion, none of my LLM API requests had been working. I didn’t even attempt to troubleshoot reside: I accepted defeat, apologized, and moved on. Throughout Q&A, somebody instructed me that an OpenAI outage had induced it. What are the chances of that taking place at that actual second? The ethical: report your demos, or run your LLMs regionally. Whichever fits you finest.

Inquisitive about AI platform engineering and CAIPE? Your start line is the official CAIPE web site. Attempt the DevNet Studying Lab proper in your browser, without spending a dime! And right here’s a small, foolish video about my Internet Summit Lisbon 2026 expertise.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Back to top button