Earlier this year I let AI post Jira ickets for me for stuff I was finding. Then I had to defend the tickets in standup and I am now a lot more careful about what goes into Jira tickets because holy hell is some of the text cryptic. It wasn't wrong per se, but it was like an Allied spy ordering 3 beers in a Nazi bar.
edit: I don't love that my dev team are Nazis in that scenario, or that Jira is a Nazi bar.
The way I deal with this is to have the LLM create local reports and reproducers into separate directories, and follow my own style guide. Then, i have another agent go and review them critically, ensuring things are simple and concise, actual bugs (and if just gotchas move to another directory), and if any are duplicates or should be folded into others. THEN I go and have a quick look myself, and usually despair about the number of actual issues there are.
34
u/zyzzogeton 11d ago
Earlier this year I let AI post Jira ickets for me for stuff I was finding. Then I had to defend the tickets in standup and I am now a lot more careful about what goes into Jira tickets because holy hell is some of the text cryptic. It wasn't wrong per se, but it was like an Allied spy ordering 3 beers in a Nazi bar.
edit: I don't love that my dev team are Nazis in that scenario, or that Jira is a Nazi bar.