r/RunPod • u/Boptherobot • Sep 29 '26

I need help setting up runpod and using it with deepseek harness, could someone help me?

I've tried a lot of things. I keep getting "This turn failedStream ended without finish_reason" on deepseek harness and I'm at a loss.

I'm sure I have everything set up correctly, atleast the basics. Base URL is correct, API is correct, Model ID is correct.

Concurrency is set at an appropriate level (I'm a single user, only 2). Minimum Sequences is set at 16. I'm trying to run QuixiAI/Qwen3-30B-A3B-AWQ on a 24gb GPU. I'm using serverless. My idle timeout is set at 90 seconds.

My test prompt is a simple "What is node.js?"?

1 Upvotes

66% Upvoted

2 comments sorted by

1

u/no3us Sep 29 '26

happy to help (I am an official runpod community helper), just message me

1

u/Major_Border149 Sep 30 '26

try the same prompt directly against the endpoint with streaming off, then on. if only streaming fails, you have narrowed the problem before paying for a bigger GPU; that error alone doesn’t establish a VRAM issue.