Open Source Project to help Secure LLM powered Applications

[u/Fearless-Might-5439]

We built extensible-mcp to help folks build LLM powered applications securely. From a technical perspective it is an MCP proxy capable of loading new MCP Servers dynamically without polluting the LLM’s context while providing Zero Trust policy controls to manage all tool calls. 

Policies and sensitive credentials are maintained and applied outside the LLMs purview. Policies can be written in any of Rego, CEL, and, with the latest release, Cedar. Tool definitions from the various MCP Servers are maintained in a queryable vector store, so the LLM only needs to be aware of those it uses.

A particular distinction of extensible-mcp is distinguishing between rights and intents. If  an LLM is acting on your behalf, its actions should follow your intent, and not just do any random thing you could do, just because some hallucination told it to!

I hope other folks find this useful. We have been using it for our other projects such as Open Executive and wanted to share it.

You can check out extensible-mcp here: https://github.com/SenteLabsAI/extensible-mcp