Evaluate
4.5.1 · What it is
Evidence rather than demonstrations. We agree what the tools must do, build an evaluation set from your own anonymised matters, run each tool against it the same way, record every defect including fabricated citations and misread facts, and report the results by tool with the method in full.
The engagement ends with a recommendation, the questions to put to the vendor, and an assurance statement for the tool you deploy that says what was tested, how, and what was found. Bandura sells no product and evaluates every vendor the same way.
4.5.2 · Who it is for
Law firms choosing between vendors, general counsel asked to approve a tool, and courts and tribunals assessing a pilot before it touches a file.
A line Bandura has built, before it is released, is evaluated the same way.
4.5.3 · What happens
- An evaluation plan agreed with you: the tasks, the tools, the criteria and what counts as a failure.
- An evaluation set built from your anonymised matters, or from ours where yours cannot be used.
- Each tool run against the set; citation and fabrication testing; defects recorded.
- Results by tool with the evidence, a recommendation and the questions for the vendor.
- An assurance statement for the tool you deploy.
4.5.4 · What you receive
- Evaluation plan
- Evaluation set
- Results by tool, with evidence
- Recommendation
- Vendor questions
- Assurance statement
Terms
Duration, deliverables and price are set out in the service schedule and agreed in a statement of work before anything starts.