Tier 1 · instant download
Hallucination evaluation starter kit
Measure how often the system is wrong, on a set you keep and can rerun.
What you get
- Golden-dataset structure
- Groundedness rubric
- CI wiring guide, so the number is produced on every change rather than once
Three ways to tell whether this applies to you.
If none of these describes your situation, this is the wrong product, and the catalog has nine others.
- Your system answers questions and being confidently wrong is a real cost
- You need a number for how often it is wrong, on a set you keep and can rerun
- You are tired of judging quality by reading a handful of outputs
The file, before you buy it
Read from the artifact itself rather than described, so what is printed here and what arrives cannot drift apart.
Every column, as it ships
- 01
item_id - 02
question - 03
expected_behaviour - 04
gold_passage_ids - 05
gold_answer_summary - 06
category - 07
difficulty - 08
source_of_question - 09
added_date - 10
last_reviewed - 11
holdout - 12
run_label - 13
assigned_label - 14
reviewer_note
hallucination-eval-starter-kit.html
7 sections, in the same download.
- Why a correct answer can still be a failure
- The five-label groundedness rubric
- The golden dataset
- Who applies the labels
- Wiring it into CI
- What MetaMinds runs
- What the number still does not tell you
What makes a golden set last
The columns split three ways, and the split is the method. Most home-made evaluation sets have only the first group.
A set with only the first group is the one every team builds and then stops trusting. holdout and last_reviewed are what stop it being quietly tuned against, and source_of_question is what lets somebody else judge whether it was ever representative.
questionexpected_behaviourgold_passage_idsgold_answer_summary
item_idcategorydifficultysource_of_questionadded_datelast_reviewedholdout
run_labelassigned_labelreviewer_note
SourceColumn names read from deliverables/T1-ASR-02/golden-dataset-template.csv at build time.
Delivery and license
Stated here rather than in the terms, because these are the questions asked before a purchase and not after it.
- Delivery
- Immediate download.
- License
- Single organization, internal use, perpetual. Adapt it for your own systems freely. Do not resell it or publish it as your own.
HTML and CSV · 14-column golden-dataset template, five-label rubric, CI wiring guide · Version 1.0 · 21 September 2026
What usually goes with this
Each of these does something this one does not, and the line under it says what. They are separate items, not an upsell path.
RAG architecture decision guide
Groundedness is mostly a retrieval property, so most of what moves the number is in the architecture decisions rather than the prompt.
$290
Prompt injection test suite
This measures whether answers are grounded. The injection suite measures whether they can be steered.
$390
Before you ask
These are the same strings this page puts in its structured data, so a person and an answer engine read identical text.
Can I buy this today?
Yes. It is $490, one payment, in USD, and the file downloads as soon as the payment clears.
What if I want the work done rather than the file?
The fixed-scope engagements on the services page cover the same ground with a person doing the work, at a published price and a fixed duration. Those are available now: a vendor AI assessment at $2,500 over three days is the smallest, an EU AI Act readiness assessment is $4,900 over one week, and an ISO/IEC 42001 gap assessment is $8,900 over two to three weeks.
What exactly is Hallucination evaluation starter kit?
Measure how often the system is wrong, on a set you keep and can rerun. It is a Tier 1 instant product from MetaMinds, listed at $490 in USD as a single payment. Tier 1 is the entry rung of a three-tier catalog: instant products from $99 to $890, fixed-scope engagements from $2,500 to $8,900, and scoped builds from $18,000.
What happens after I pay?
The download link and your invoice are emailed to you immediately, and the link stays good for 30 days and up to 20 downloads. Because a file you have already downloaded cannot be returned, the checkout asks you to confirm before paying that downloading ends your 14-day right to withdraw. That is Article 16(m) of the Consumer Rights Directive, and it is why the box is there and why it starts unticked.
It downloads the moment you pay.
No call, no scoping, no waiting. If you would rather a person did this work, the engagements on the services page cover the same ground at a fixed price and a fixed duration.