Evaluations and Quality
Grade captured outputs before trusting a production change.
Acta samples successful captured rollouts and records verifier grades for instruction adherence, errors, and output usability.
Keep the sample, criterion, and score reviewable.
Each grade records what the verifier assessed while leaving business acceptance to the accountable team.
Captured sample
Recent successful rollouts with captured request and response content for the selected scope.
Metadata-only privacy mode prevents rollout capture.
Instruction adherence
Whether the response followed the request and stayed on task.
A verifier score does not establish the business Outcome.
Error review
Whether the response appears free of factual, logical, or code errors.
The grade reflects the verifier and sampled content available at that time.
Output usability
Whether the response is complete, well formed, and usable for its stated purpose.
Workflow owners still decide whether the completed job was accepted.
Persisted grades
Keep criterion-level scores and evaluation-run averages for later review.
Grades are review evidence. They do not approve a production change.
Scope and context
Evaluate a named Workload, an API key, or recent captured project traffic.
The sample may not represent every production case or failure mode.
A passing grade should not change production by itself.
Use the grade as review evidence. Acta does not currently feed verifier grades into automatic routing or treat them as proof that the business accepted the completed job.
See how current supplier routing works- Criterion
- What the verifier checked
- Sample
- Which captured rollouts were graded
- Score
- What the verifier returned
- Decision
- What accountable owners still need to determine
Need a customer-approved pass/fail comparison?
The manual design partner assessment compares one live workflow and agreed alternatives against one measure your team approves.