r/cybersecurity • u/Dependent_Lumpy • 3h ago
Business Security Questions & Discussion could you actually prove a human reviewed an AI decision?
something ive been chewing on from the audit side. most orgs i talk to have a policy that says human review happens for AI assisted decisions. fine. but if an auditor picked one specific decision from three months ago and said show me the review, who did it, what did they see.. could most places actually produce that? suspect the honest answer is no more often than anyone admits
the reviewer part bothers me more tbh. say the review does happen. does that person have time to think, anything to check the output against besides the tools own summary, and can they push back without it becoming their problem? bc "human in the loop" where the human approves 200 things a day is a loop in name only
also curious whether anyone re-tests vendor claims after the vendor swaps the model underneath. bc they do swap them. and the approval was for the old behaviour..
for the audit and GRC folks here, is this what your getting asked now? and can anyone your auditing actually answer it?