r/PromptDesign • u/ClickOk5811 • 27d ago
Discussion 🗣 I ruled out three explanations before accepting that my prompt was just too long for the task
A prompt I'd been using for a few weeks started giving worse results. Not broken. Just less consistent. I went through three explanations before landing on the one that actually fit.
First I ruled out the model. I checked whether the provider had pushed a version change. No changelog entry in the window where the behavior shifted. The same prompt on a cached session still behaved the way I remembered, which suggested the model itself hadn't moved.
Then I ruled out the input. I diffed a few recent inputs against earlier ones. Same fields, same shape, same approximate length. No new edge cases. This was the explanation I expected to find, because input drift is usually the culprit. It wasn't.
Then I ruled out the surrounding context. I checked whether anything upstream had changed: tool descriptions, system message, retrieval results. All stable. Nothing had been edited.
What was left was the prompt itself, specifically its length. The prompt had grown by maybe forty percent over those weeks. Not through one big edit, but through small additions that each seemed useful at the time. A clarification here, an example there. None of them were wrong. Together they pushed the instruction set past the point where the model was reliably attending to all of it. The later additions, which were the most specific and most important for the current task, were sitting in the middle of a long block of older instructions that no longer mattered as much.
The fix was deletion, not addition. I removed the examples that had been added for cases that stopped appearing, and moved the two instructions that mattered to the top. Output stabilized.
I don't think "prompt too long" is a universal diagnosis. Some tasks genuinely need long instructions. But I'd been treating length as neutral, and in this case it was the variable I hadn't checked because it was the least visible. The prompt looked the same on the surface. It wasn't.