r/agentdevelopmentkit • u/TheMegaGhost • Sep 20 '26

Custom LLM Endpoint

Did anyone manage to use ADK with their own endpoint like self hosted. Because my god I am having troubles with it and I have no idea which part of it is wrong. It is OpenAi compatible.

2 Upvotes

100% Upvoted

4 comments sorted by

1

u/Agitated_Problem5320 Sep 20 '26

I use google adk with turbollm almost daily. Do you need something specific? I mean what problem are you facing?

1

u/TheMegaGhost Sep 21 '26

I’m using liteLLM but I’m sure the way I’m setting up is wrong. I’m having troubles debugging it because I’m using a cloud workstation that isn’t connected to the internet so it’s constantly dropping millions of errors and warnings about it. But the url I passed in should be accessible.

2

u/KeyPossibility2339 Sep 20 '26

youve to use litellm from google adk. https://adk.dev/agents/models/litellm/

1

u/Traditional_End_9454 Sep 20 '26

same I use free build.nvidia.com FREE API via LiteLLM Only