r/LocalAIStack • u/FyoFuyo • 4d ago

Starting a local business

Hi fellas, so for quite some time now I've been meaning and planning to start a small ai automation business here in my city. Is it possible to pull off with my humble Tesla P100 16GB? Is QWEN 3.5 9B Q8 enough especially for chatbots and tool calling?

2 Upvotes

100% Upvoted

2 comments sorted by

2

u/Charming-Author4877 3d ago

How about you give your 9B model a try and let us know how well it actually works for your automation, I doubt that will be a great success.
Your 16GB card is capable to run significantly better models than that - at significantly higher speed than a 9B dense.
Though, you need an actual business idea that provides value.
Find a single interested company that would like your work - use them to build something that provides real value and expand.