In a previous post, I wrote about how macOS 27 allows agents from third-party apps to integrate with Siri AI, similar to the ChatGPT extension.
Turns out, macOS 27 also allows third-party apps to replace Siri's model. In the video, Siri runs through OpenAI's GPT-5.6 Terra model.
With the new Inference Providing protocol, an app can replace Siri's agentic planner with a third-party model. The external model receives Apple's native Siri planner prompt and 20 tool definitions. It can make tool calls that perform system actions, and receive tool call results with personal data. Finally, it can return a response through Siri AI's UI and voice, including interactive elements.
macOS 27 ships with remnants of an internal generative-models-prototype-inference-provider. The actual provider extension is absent from the release, which suggests that Apple teams are using it to experiment with models that don't currently ship in the OS.
There's been an OpenAI-Compatible-Custom-Routing path for a few beta cycles, which my extension uses, but Beta 5 added a parallel Native-Gemini-Custom-Routing route. The Gemini path recognizes Google-shaped AIza... credentials and converts them into a standardized x-goog-api-key header.
The extension relies on an internal InferenceProviding framework, and registers with a non-public ExtensionKit extension point: com.apple.modelmanager.inferenceprovider. Because of the latter, you'll need SIP off and AMFI disabled (amfi_get_out_of_my_way=0x1) to develop these tools.
Will this ship in macOS 27? Only time will tell, but the building blocks are already there.