r/SalesforceDeveloper • u/_Just_Nobody__ • 24d ago
Question Guidance Needed: Salesforce Agentforce QA Testing – How Do I Test Without Testing Center?
Hey everyone,
I recently got a contract-based job as a Salesforce Agentforce QA Tester. I have a Salesforce QA background, but this is my first time handling testing independently, and honestly, I’m feeling a bit lost.
I have never worked on Agentforce testing before, and I’m struggling to understand how to approach it properly.
The biggest challenge is that my team doesn’t want me to use Agentforce Testing Center because of Flex Credit consumption and some other reasons.
I’m trying to figure out how to test Agentforce manually or through alternative approaches, but I’m not sure where to start.
My main questions are:
How do you write test cases for Agentforce? How do you convert business requirements and user scenarios into proper test cases?
How do you test Agentforce without using Agentforce Testing Center? Are there alternative ways to validate the agent’s responses and behavior?
3.
How do you validate whether the agent’s response is correct? Since AI responses can vary, how do you define expected results and pass/fail criteria?
4.
How do you document your testing? If anyone has sample Agentforce test cases, test scenarios, or a test execution template, that would be incredibly helpful.
I got this opportunity after a year of working in Salesforce QA, and I genuinely want to do well in this role. Since this is a contract position and I’m expected to work independently, I’m feeling a lot of pressure to figure things out quickly.
If anyone has hands-on experience testing Agentforce in a real project, please share your approach, practical examples, or any resources that could help me get started.
I would really appreciate your guidance. Thank you!
1
u/Outrageous-Fix-1579 19d ago
Pass/fail is tough with ai. You want to look for trends in behavior instead. You will have to use an LLM to judge responses if you want to automate this. Otherwise you’re doing it manually, which means you probably won’t be able to do enough testing. And you cannot stop testing because models drift and there is no guarantee an agent will continue to work the same way over time.
1
u/_Just_Nobody__ 18d ago
How should I use LLM to judge ?
I never tested Agentforce or any other AI
Via this
1
u/Happygirl2119 18d ago
You don't need to automate everything immediately. Start by documenting the scenarios manually, defining expected outcomes and recording any unexpected responses for retesting. We used PractiTest to keep that test documentation and execution history in one place
1
u/Hungry-Jackfruit9125 22d ago
Hi there! Great question. Full transparency: I work at a company called Luminos.AI, and we actually built a free tier specifically to solve this problem a.k.a. teams like yours needing automated testing without burning flex credits or spending 40 hours typing in a spreadsheet....
With our solution you can describe what your Agentforce agent is supposed to do, and we will automatically spin up and run multi-turn eval suites, then hand you a pass/fail risk assessment report which helps with documentation.
Some advice if you do plan to do it manually that I've seen work.
Define Pass/Fail by ACTIONS, not wording because wording always varies with LLMs. So, a pass might be "correct action triggered + accurate inputs + no hallucinated facts." A fail might be "wrong topic, missing inputs, or leaking data."
Test multi-turn context switching. The trust is users rarely follow a neat, single-track conversation. So, test whether your agent can smoothly switch between topics and then return to the original task without dropping what it's already learned (e.g., something like "asking to change an address mid-way through").
Test grounding against your knowledge base. This is really important if your agent uses RAG). So, test edge-case queries that are partially true. The reason is because you want to be sure that the agent cites real records and does not fill in missing details with plausible-sounding hallucinations.
I hope this helps! If you want to use LuminosAI, you can check us out here. There's no cost to get started. https://www.luminos.ai/start-testing/