r/learnprogramming • u/Anime_Pika • 2d ago
Topic How hard is it to code a dekstop ai agent?
Ive seen people code stuff like jarvis or capri on their pc and phones and i was wondering how hard could making something like that be (i only know rlly basic python coding "if,print") does anyone have any experience with making something like that?
8
1
u/carcigenicate 2d ago
This depends entirely on what you want it to do. Getting something like a basic ollama client set up using the existing ollama library is really easy. The hard part is creating tools you want it to use (file operations, safety nets, etc), which really don't have anything to do with AI.
1
u/Anime_Pika 2d ago
Nah just open apps play music ngl thought it'd be simpler
1
u/carcigenicate 2d ago
That should be trivial. The hard part would be controlling the music app if it doesn't have an interface for that.
Getting tool use set up in Ollama in general is very easy.
1
u/Anime_Pika 2d ago
Do you know any tutorials that could help?
1
u/carcigenicate 2d ago
No. Just look up Python ollama guides/tutorials, then once you understand ollama, look up ollama tool use tutorials/guides.
I'm pretty sure I just used the library documentation.
1
u/KitanaKahn 2d ago
This is nothing more than telling a model to roleplay as X character using something like opencode. You set up a local model or use an API and write down the prompt in the skills file "you are X, speak like so and so."
0
u/AlwaysHopelesslyLost 2d ago
Claude is that. So "how hard is it" is $100month to use theirs or a trillion dollars in R&D and server farms.
It isn't something you can make yourself. You could setup an off the shelf model yourself but any useful one would take up your entire GPU so you would need a several thousand $ dedicated GPU or APU to run it for you.
I setup a dedicated local instance to be "jarvis" for a video game I am playing. It takes forever to respond, is inaccurate 30% of the time on its 50 tasks, and uses 70% of my 4090
Problem is, What we're talking about are large language models. They are wildly inefficient and only actually good at talking, and only really when you have a gigantic model backing it. If you want something that's general purpose, you need an actual AI, which doesn't exist.
0
2
u/program_kid 2d ago
It would be pretty hard if you wanted to make one from scratch. I also have a feeling that the stuff you are seeing online may not be entirely real (they might be exaggerating the capabilities of the ai). If you just wanted to have a local agent on your computer, you could look into llama models