Before bringing an AI tool into your classroom, you need to know more than whether it produces impressive results. You need to understand what it contributes to learning, what information it collects, how reliable its outputs are, and whether your students can use it fairly.
I recommend starting with a specific teaching task. “Is this a good AI tool?” is difficult to answer in the abstract. “Can this tool help my Grade 8 students compare arguments without doing the analysis for them?” gives you something concrete to evaluate.
The checklist below walks through the main questions to ask. Use it when exploring a new platform or reconsidering one you already use. A tool might be suitable for drafting teacher materials while requiring different safeguards for direct student use.
AI Tool Evaluation Checklist at a Glance
| Area | Main question |
|---|---|
| Learning purpose | What learning goal does this tool support? |
| Student thinking | What intellectual work will students still do? |
| Accuracy | Can its outputs be checked against reliable sources? |
| Privacy | What information does it collect, retain, and share? |
| Age suitability | Is this use permitted and appropriate for these students? |
| Bias and representation | Whose perspectives appear, and whose are missing? |
| Accessibility | Can students access and use its essential features? |
| Equity | Does participation depend on paid features or personal devices? |
| Teacher oversight | Can you review and control its use? |
| Practical fit | Is the benefit worth the setup, cost, and checking? |
1. Start with the Learning Purpose
An AI tool should have a clear role in the lesson. Identify the outcome first, then decide whether the tool helps students work towards it.
- I can name the learning goal this tool supports.
- I can explain why its features are useful for this particular task.
- Its output matches the subject, grade level, and curriculum context.
- I have considered whether a simpler resource would serve the task.
- I know what evidence would show that its use helped.
For example, generating several explanations of a science concept could support comparison. Students would still need to examine those explanations and justify which is most accurate.
2. Check What Thinking Remains with Students
A tool can make a task easier while removing the work students need to practise. Look closely at who generates ideas, selects evidence, makes decisions, and explains the result.
- Students retain responsibility for the thinking named in the learning goal.
- I have identified what students should attempt independently.
- Students will evaluate AI suggestions before accepting them.
- The task includes evidence of students’ own understanding.
- I can explain how AI assistance differs from completing the task for them.
Try a simple removal question: If students completed this activity without AI, what thinking would they need to do? Then examine which parts the tool takes over.
3. Test Accuracy and Reliability
Test the tool with material you know well before relying on it for unfamiliar content. A polished response can still contain incorrect explanations, invented references, or misleading simplifications.
- I have checked several outputs against reliable sources.
- I have tested subject-specific terminology and examples.
- I have verified citations and links where provided.
- I have checked whether simplification changes the meaning.
- I can review generated materials before students use them.
For student-facing chatbots, also consider what happens after the first response. Follow-up questions may produce different claims or introduce new errors.
Related: Assignment AI-Permission Scale: A Practical Guide for Teachers
4. Review Privacy and Data Handling
Check your school or district’s approved-tool guidance before creating student accounts or uploading information. Read the provider’s current privacy documentation for the product and account type you intend to use.
- I know what information the tool collects.
- I understand its stated retention and deletion arrangements.
- I have checked whether submitted content may be used for model training.
- I know whether information is shared with other providers.
- I understand the permissions required for classroom use.
- My planned activity avoids unnecessary personal or confidential information.
Use fictional examples when testing. Student work can contain identifying information even after names have been removed.
5. Confirm Age Suitability
Access to a website does not establish that students are permitted to use it. Check the provider’s current terms and your institution’s requirements.
- The intended use meets the tool’s age and account requirements.
- Required permissions have been addressed.
- Instructions and generated content suit students’ developmental levels.
- I understand the available content controls and their limits.
- Students know what to do if they encounter inappropriate content.
Teacher-operated use and independent student use may require different decisions.
6. Examine Bias and Representation
Evaluate how the tool portrays people, communities, languages, and experiences. Include examples relevant to the students you teach.
- I have checked for stereotypes and deficit assumptions.
- Examples reflect varied identities, families, and circumstances.
- Generated content does not present one perspective as universal.
- Language varieties and multilingual responses receive careful review.
- I can identify relevant perspectives that require other sources.
An instruction to “avoid bias” does not establish that the resulting material is fair or representative.
7. Check Accessibility and Equity
A useful feature only helps when students can access it. Test the actual workflow, including signing in, entering information, reading outputs, and exporting work.
- Essential functions work with students’ accessibility supports.
- Text, audio, images, and controls are usable for the intended learners.
- Required features are available without unexpected payments.
- Device and internet requirements fit classroom conditions.
- Students have an equivalent route to the learning goal if they cannot use the tool.
A free account may have limits that matter during a lesson. Check usage caps and restricted features before planning around them.
8. Evaluate Teacher Control and Practical Fit
Consider the work involved after generating an output. Editing, verification, account management, and troubleshooting all affect whether the tool is worth using.
- I can edit or reject generated materials.
- I can explain acceptable use clearly to students.
- I can review the evidence needed to assess their understanding.
- Useful materials can be exported or retained appropriately.
- Setup and checking time are reasonable.
- I have a workable plan if the tool fails.
Make a Decision and Revisit It
After testing, record one of four decisions: use, use with conditions, investigate further, or decline for this task.
Write down the reason and any conditions, such as teacher-only operation, fictional input data, or independent student work before AI assistance. Avoid reducing the checklist to a total score: an unresolved privacy requirement cannot be cancelled out by several convenient features.
Revisit the decision when features, terms, student needs, or the lesson purpose change. Your evaluation belongs to a particular use, with particular learners, under particular conditions.
Further readings
Further Reading
- UNESCO: AI Competency Framework for Teachers
A framework for developing teachers’ AI knowledge, ethical judgement, and pedagogical practice. - European Commission: Guidelines on the Ethical Use of AI and Data in Teaching and Learning
Guidance on the opportunities, risks, and ethical questions surrounding educational AI. - TeachAI: AI Guidance for Schools Toolkit
Resources covering responsible implementation, equity, privacy, AI literacy, and ongoing evaluation. - Common Sense: Privacy Evaluations
Evaluations to help educators investigate educational tools’ privacy practices. - UNESCO: Guidance for Generative AI in Education and Research
Guidance on evaluating and adopting generative AI through a human-centred approach. - Common Sense Education: Practical Tips for Teachers to Use AI
Practical advice on checking AI-generated information, verifying sources, and using tools thoughtfully.
