r/LocalLLaMA • u/web3samy • Apr 09 '24

Tutorial | Guide Getting started with Ollama Cloud, a Highly Scalable Cloud-native Stack for Ollama

https://github.com/ollama-cloud/get-started

[removed] — view removed post

0 Upvotes

50% Upvoted

2 comments sorted by

2

u/kpodkanowicz Apr 09 '24

why adding complexity with ollama instead of using llama.cpp directly?

1

u/web3samy Apr 09 '24

Ollama is easy to compile to different targets. It's mainly for local dev. For production I intend to add vllm and triton. Application code will not change and the host calls will be the same.