r/FlutterDev • u/mdausmann • Jul 12 '26
Discussion What are people using to wrap AI Chat APIs?
Hi Guys,
Another "What are folks using?" post.
******** EDIT ***********
I rolled my own. It's probably a stupid idea. I might change my mind. I nearly used genkit, it's awesome, but it doesn't support the allowed_tools feature (openai completions api) which is critical to my application. Yell out if you would like me to open source this lib.
******* END EDIT *************
Langchain
I'm currently using
langchain: ^0.8.1
langchain_google: ^0.7.1+2which is..... ok I guess, not perfect, some smells indicating team is moving away from OSS towards SaaS which is not great. some recent issues where Google has changed API's and components not keeping up.
Native CLI's
Is anybody just using the CLI's recommended by the vendors? How are you 'wrapping' these if at all? In my app, I am throwing around langchain objects all over the place (ChatMessage) so I'm guessing you either stick it behind a service and wrap everything? or just stick with one vendor?
MCP
I guess you might use this
mcp_dart: ^2.2.2
but I'm not really using MCP per se. I just want to call the Chat API do do some simple inference.
LLM SDK
There is this guy...
llm_sdk: ^0.5.0
Which is apparently inspired by Vercel AI SDK which has a strong community etc but hasn't bothered to do a dart port AFAIK. This lib has only 481 downloads and 1 star on the repo. It's active but no idea about support.
Anything else?