A convincing answer still needs a proper check.
A tool produces documents quickly and the leader likes the first examples. A closer review reveals missing conditions and incorrect conclusions. Participants disagree about quality because they assess different aspects of the text and have not agreed a shared evaluation method.
Go straight to the possible work ↓A useful distinction
What makes the output difficult to evaluate?
Not sure yet: general approachConsidering this option: People disagree about acceptable quality
Where we could start
Define usable output with users and relevant specialists. Prepare ordinary and difficult examples, evaluation criteria and a process for resolving disputed assessments.
What you would have
An evaluation brief covering examples, quality requirements, significant errors and the people responsible for assessment.
Who needs to be involved
The task owner, people using the output and specialists qualified to check its content.
Roles and decisions
I organise requirements preparation and evaluation. Specialists assess domain accuracy; the task owner makes the final decision about use.
This is a starting point for a conversation. We would check the approach against your task.
Prepare an enquiry
This is an editable starting outline, not a submitted enquiry. Add your own circumstances.