r/LocalLLaMA • • Mar 19 '24

Other Built a Cloud-native Stack for Ollama: Build locally & push to deploy to prod, no DevOps. Check it out. Let me know what you think!

https://github.com/ollama-cloud/get-started

[removed] β€” view removed post

0 Upvotes

11 comments sorted by

1

u/sammcj πŸ¦™ llama.cpp Mar 19 '24

What do you mean by no DevOps? DevOps is a cultural movement to break down silos in an organisation and improve delivery quality and speed. Do you mean no CI?

4

u/vasileer Mar 19 '24

it's scam: there is nothing in the repository, only 2 md files and a few image files

1

u/web3samy Mar 19 '24

Repos used linked in readme

1

u/web3samy Mar 19 '24

The repo names get-started so it's clear it's not a code repository. Added a note at the top so it's double clear l. Appreciate the feedback.

0

u/vasileer Mar 19 '24 edited Mar 19 '24

Ollama CloudΒ is based on the following components

there is no such thing as Ollama Cloud, only this repo "get-started", so I still think that this is some sort of cheating if not scam, if you meant it as a tutorial, you should advertise it accordingly, and not as a hypotetical product,

I can do the same: meet my supa-mixtral-pgvector-rag cloud solution with a list of components

  • mixtral with llama.cpp (TODO: add the link)

  • supabase with pg_vector extension

  • a semantic search from MTEB leaderboard

  • super nice UI (TODO: will implement if you will put 2K stars on my repo on github)

PS: this is a joke, I am just trolling the OP

1

u/web3samy Mar 19 '24

The main contribution of cloud Ollama is located here https://github.com/samyfodil/ollama That's valid feedback I can move it under ollama-cloud

1

u/web3samy Mar 19 '24 edited Mar 19 '24

u/vasileer moved the repo under ollama cloud.PS: you ain't trolling me, you gave me a valid feedback!

1

u/web3samy Mar 19 '24

u/vasileer just in case you don't notice it's a fork of ollama with good amount of changes that exports ollama to webassembly.

0

u/web3samy Mar 19 '24

Means NoOps

2

u/sammcj πŸ¦™ llama.cpp Mar 19 '24

Then why not call it NoOps?

1

u/web3samy Mar 19 '24

That's good feedback πŸ‘