How to catch AI mistakes in your own assignments
AI tools produce text that sounds confident even when it is wrong. They fabricate citations, mix up definitions, and invent statistics. If you use AI for an assignment, verify every factual claim, check every citation, and test every code block. The penalty for submitting wrong information is on you, not the AI.
How AI gets things wrong (while sounding right)
AI models do not know what is true. They predict what text is likely to follow based on patterns. This means they can produce output that is grammatically perfect, logically structured, and completely wrong.
Hallucinated citations. Ask AI for references and it will invent author names, journal titles, and publication dates that do not exist. The format looks correct. The papers are fictional. If you cite them, you lose marks and credibility.
Confident but incorrect definitions. AI can define a technical term in a way that sounds right but misses a key detail. It might say "a foreign key is a column that links to another table" while leaving out that it must reference a primary key. Close enough to fool you, wrong enough to cost you marks.
Invented statistics. "70% of Kenyan developers use Python" sounds plausible but may be completely made up. AI generates statistics that fit the narrative without checking whether they are real. If you include them in an assignment, your lecturer may ask for the source.
Outdated information. AI models have training cut-offs. They may give you information that was correct two years ago but has changed. Laws, API versions, framework features, and company policies all change faster than models update.
How to verify AI output before you submit
Check every citation. Search for the paper title, author, and journal in Google Scholar. If the paper does not exist, remove the citation. If it does exist, read the abstract to confirm it says what the AI claims it says.
Cross-reference facts with primary sources. If the AI says Python was released in 1991, check python.org. If it claims a specific Kenyan law governs data protection, check the gazette or a legal database. Primary sources are the only reliable check.
Test all code. Copy the code into your development environment and run it. AI-generated code often has syntax errors, missing imports, or logical bugs. If the code does not run, fix it. If you cannot fix it, you do not understand it well enough to submit it.
Ask AI to critique its own output. This is a useful but imperfect technique. Prompt: "Review the following text for factual errors and unsupported claims." The AI may catch some of its own mistakes. But it can also defend them. Use this as one check, not the only one.
Read your submission as if you wrote every word. If a sentence contains a claim you cannot explain or defend, remove it or verify it. Submissions that contain sentences the student clearly did not understand are easy for lecturers to spot.
Red flags that signal AI errors
Round percentages with no source. "60% of companies" or "80% of graduates" with no citation. Real statistics come from real studies. AI statistics come from pattern prediction.
Suspiciously clean examples. AI-generated code examples often use variable names like "data," "result," and "output." They work for simple cases but break on edge cases. Test with unusual inputs.
Over-confident language. "It is well established that..." or "Research clearly shows..." are phrases AI uses to present claims with authority it does not have. If the claim matters, find the actual research.
Correct structure, wrong content. AI is very good at producing text that follows the right format (introduction, body, conclusion) while filling it with information that is partially or fully incorrect. Structure is not a guarantee of accuracy.
Mixing up similar concepts. AI often confuses related but distinct concepts: authentication vs authorisation, TCP vs UDP, stack vs queue. It knows the terms exist and that they are related, but it may swap their definitions.
What to do this week
- In your next assignment that uses AI, verify every factual claim against a primary source.
- Check any citations AI generated by searching for them in Google Scholar.
- Run every line of AI-generated code in your own environment before submitting.
- Read your final submission and mark any sentence you cannot explain. Verify or remove it.
Frequently Asked Questions
- How much time does verification add?
- About 30 to 60 minutes for a typical assignment. This feels like extra work, but it is part of the job. Using AI without verification is like driving without brakes. It is faster until you crash. The verification time is what separates a useful AI-assisted workflow from a dangerous one.
- Is there a tool that verifies AI output automatically?
- Not reliably. Some tools claim to fact-check AI text, but they often use AI themselves, which introduces the same problem. Manual verification against primary sources is the only reliable method. For code, running it is the verification.
- What if I submitted AI-generated work with errors in the past?
- Learn from it and improve your process going forward. If the errors were caught and you lost marks, treat that as tuition paid for the lesson. If they were not caught, do not assume you got away with it. Fix your workflow so every future submission is verified.
Related articles
How to use AI tools for university work without cheating yourself
How to use AI tools like ChatGPT for university work in Kenya without plagiarism or cheating yourself out of learning. Where AI helps and where it hurts.
Is prompt engineering a real skill for students, or a fad?
Is prompt engineering a real career skill or just a trend? What it actually involves, whether it will last, and how students should think about it in 2026.
