Audit Finding
Correctedhallucination
Generic AI
Federal -- hallucination
The Claim
AI tax chatbots give consistent, reliable answers to tax questions and can be trusted as a source of tax law citations.The Error
NerdWallet's Data Studies team tested ChatGPT, Gemini, and Perplexity across seven tax questions and 50,000+ words of transcripts. Two documented failures: (1) when the same question was asked multiple times, the AI gave inconsistent answers — a reproducibility failure that eliminates any audit trail; (2) AI chatbots hallucinated nonexistent legal case citations in tax responses. NerdWallet's lead tax writer Sam Taube stated the tendency to cite nonexistent cases "still comes up in 2026" and that AI "is not a reliable source of truth yet" on taxes.
The Citation
NerdWallet Data Studies, "Analysis: What AI Gets Right (and Very Wrong) About Taxes," Kurt Woock, March 3, 2026. https://www.nerdwallet.com/taxes/studies/doing-taxes-with-ai
Business Impact
A user who receives inconsistent answers across sessions cannot verify what the AI told them — eliminating the audit trail needed if the IRS questions a filing position. A hallucinated case citation used to support a deduction claim fails under audit when the citation cannot be produced. Tax law citations are load-bearing; a wrong or fabricated one is not a minor error.
Verdict
KKATC Tax Response
Note
Source: NerdWallet structured study, 50,000+ word transcript corpus, three AI systems tested (ChatGPT, Gemini, Perplexity). Named source: Sam Taube, NerdWallet lead tax writer. Published March 3, 2026. sourceVerified: direct quotes from named author at verifiable URL.KKATC Tax Prep and Consulting
This scenario is covered.
If AI gave you advice like this, a review costs less than the penalty. Twelve years of Fortune-level corporate tax experience.
Book a Consultation →