Fact-Checking & Citation Verification
Sample Type: Simulated AI Accuracy Evaluation
Focus: Claim Verification, Source Quality & Unsupported Statements
Evaluation Method: Claim-Level Verification
Skills Demonstrated
Fact-Checking • Claim Identification • Accuracy Assessment • Source-Quality Judgment • Unsupported-Claim Detection • Correction Writing
Task Overview
Review an AI-generated response containing factual claims. Identify claims requiring verification, determine whether they are supported, unsupported, inaccurate, or overly broad, and document corrections where necessary.
User Prompt
“Why are honeybees important to agriculture?”
AI Response Evaluated
Honeybees are essential to agriculture because they pollinate every fruit and vegetable crop grown in the United States. Without honeybees, farmers would be unable to produce almonds, apples, blueberries, cucumbers, and many other foods. Honeybees are the only insects used commercially for agricultural pollination, and approximately 90% of the world's food supply depends directly on them. California almond growers depend heavily on managed honeybee colonies during the annual almond bloom.
Claim Verification
Claim 1
“Honeybees pollinate every fruit and vegetable crop grown in the United States.”
Rating: Inaccurate
Evaluation:
This claim is overly broad. Many agricultural crops benefit from insect pollination, including honeybee pollination, but not every fruit or vegetable crop depends on honeybees. Some crops are wind-pollinated, self-pollinating, or pollinated by other insects.
Correction:
Honeybees contribute to the pollination of many important agricultural crops, but they do not pollinate every fruit and vegetable crop.
Claim 2
“Without honeybees, farmers would be unable to produce almonds, apples, blueberries, cucumbers, and many other foods.”
Rating: Misleading / Overstated
Evaluation:
Honeybees provide important pollination services for numerous crops, but the statement treats their absence as equivalent to complete inability to produce all listed foods. Pollination systems vary by crop and can involve native bees and other pollinators. The claim should distinguish between reduced production and absolute inability to produce a crop.
Claim 3
“Honeybees are the only insects used commercially for agricultural pollination.”
Rating: Inaccurate
Evaluation:
Honeybees are major managed agricultural pollinators, but they are not the only commercially managed pollinating insects. Other bee species, including bumblebees and some solitary bees, are also used for crop pollination.
Claim 4
“Approximately 90% of the world's food supply depends directly on honeybees.”
Rating: Unsupported / Inaccurate
Evaluation:
This statistic should not be accepted without strong supporting evidence. It substantially overstates the direct dependence of the global food supply on honeybees and fails to distinguish honeybees from pollinators generally.
The precision of the “90%” figure makes source verification particularly important.
Claim 5
“California almond growers depend heavily on managed honeybee colonies during the annual almond bloom.”
Rating: Supported
Evaluation:
This is consistent with established agricultural practice. Commercial almond production in California relies heavily on managed bee colonies for pollination during bloom.
Source Quality Assessment
For a fact-checking task of this type, preferred sources would include:
-
U.S. Department of Agriculture
-
Agricultural extension programs
-
Peer-reviewed agricultural or ecological research
-
University research institutions
-
Government agricultural agencies
Unverified blogs, marketing websites, social media posts, and AI-generated summaries should not be treated as primary evidence for disputed factual claims.
Overall Evaluation
Accuracy Rating: 2/5
Classification: Needs Significant Correction
Evaluator Summary
The response correctly communicates the broad importance of honeybees to agriculture but undermines that message through several exaggerated or inaccurate claims. Statements using absolute terms such as “every” and “only,” and claims involving a precise global percentage, require particular scrutiny. The California almond statement is substantially stronger and consistent with established agricultural practice. The response should distinguish honeybees from pollinators in general and avoid equating agricultural dependence with an inability to produce particular foods.
Portfolio Note
This simulated sample demonstrates a claim-level fact-checking methodology. It is an independent portfolio exercise and does not represent work completed for a particular AI company or evaluation platform.
NEXT SAMPLE: AI Error & Failure Analysis -->