Your question is Prompt Regression Evaluation Framework. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Explain how you would design an evaluation framework to measure the accuracy and regression of prompt changes across thousands of diverse test documents at Reducto.
Address dataset curation, ground-truth labels, batch execution, objective and human evaluation, regression detection, release gates, and monitoring. Discuss how the design handles document diversity, nondeterministic model outputs, prompt versioning, evaluator disagreement, and cost or latency constraints.