Preparing Learners to Think Beyond the Output: The Role of Evaluative Judgement

Preparing Learners to Think Beyond the Output: The Role of Evaluative Judgement

The Education/Generative AI debate has reached a groundswell of debate about the struggle to secure assessment. TEQSA's latest resource, Assuring Quality Learning in a Gen AI-Integrated Future, marks a shift in a debate.

Written by Toni Jones, Lead, Education Gen AI 

Students must not only know how to use gen AI but also activate the regulatory processes that enable them to evaluate AI-generated content, recognise illusions of understanding and make deliberate decisions about when to rely on or step away from gen AI.

(Lodge et al., 2026, p.10)

The most important capability we can support is not simply how students use AI tools, but how they evaluate the Gen AI outputs and content they produce and encounter. Preparing students for an AI-rich world means helping them question accuracy, assess credibility, recognise limitations and bias, and decide when AI outputs should be trusted, adapted, or challenged.

The recent TEQSA report, Assuring quality learning in a Gen AI-integrated future: The role of adaptive capabilities, makes a strong case that adaptive capabilities are essential for navigating a Gen AI world.

A key part of adaptive capability is self-regulated learning, including evaluative judgement: the capability to judge the quality of work, whether your own or someone else’s (Tai et al., 2018). Tai and colleagues (2018, p. 471) describe this as having two core components: understanding what constitutes quality, and being able to make judgements about work. Both are developed through deep disciplinary knowledge (Lodge et al., 2026).

This creates a challenge. A university degree plays an important role in developing evaluative judgement (Bearman & Luckin, 2020), yet Gen AI can also enable novice learners to bypass the cognitive effort required to develop foundational disciplinary knowledge (Ke et al., 2026).

In a Gen AI context, evaluative judgement also extends beyond assessing the quality of work. Students need to consider ethical use and decide when and where to use Gen AI (Lodge et al., 2026).

How educators are supporting students to engage critically with Gen AI

So, as educators, we face a conundrum: how do we help students develop evaluative judgement while they are still building the disciplinary knowledge needed to make those judgements well?

The following examples show some ways of how this can look in practice. Each case creates a structured moment where students do more than use Gen AI: they pause, compare, question, explain, and make judgements about the role AI should play in their learning. These moments help students recognise and articulate how learning occurs, making their thinking and decision-making processes explicit (Lodge et al., 2026). 

In a STEM Machine Learning course, educators Dr Zhendong Huang and Dr Shuwen Hu encourage students to use an AI tool for a project assessment task, but they must also describe how they used it. Students must explain which tool they used, what they used it for, how they checked and verified outputs, and what improvements they made with AI assistance. The task requires students to disclose, explain, validate, and reflect on their use of AI.

Another example comes from Jo Bradley at RMIT UP Foundation Studies in STEM. Students first created their own mind maps and recorded short explanations of the concepts and connections they had identified. These artefacts were then used to prompt Google Gemini to generate a consolidated mind map. Students critically reviewed the AI-generated version for accuracy, completeness, misconceptions, and missing information. The result was a student-verified study worksheet that supported revision while developing students’ capacity to evaluate AI-generated content.

These examples also reinforce Lodge et al.’s point that students who learn and think ethically with Gen AI need more than tool skills. They draw on regulatory skills, ethical judgement, and disciplinary knowledge (2026, p. 10).

Emilio Kardaris, Lecturer in Chiropractic, takes such an approach by using AI role play to help students practise and critique communication before applying it in live settings:

"In a final-year chiropractic course, I use a generative-AI role-play tool to help students practise behaviour-change conversations before performing them live. Students experiment with different approaches and watch the AI scenario shift in response, prompting them to question why, or why not, their communication worked. We then unpack these interactions in class, focusing on the limits of AI simulations, patient nuance, and the importance of clinical reasoning beyond the algorithm. This approach gives students a safe space to think critically about AI’s role in practice while strengthening their ability to guide real patients through meaningful change."

Peter Murphy, Associate Lecturer in Primary Curriculum and Pedagogy in the School of Education, approaches this through collaborative and networked learning:

"In my teaching, I invite students to treat AI as a speculative collaborator within a shared, networked learning environment. Drawing on the principles of Connectivism, we use collaborative digital platforms to make collective thinking visible and open for feedback. For example, I may prompt students with "How might we leverage AI to help manage complex classroom behaviours?" Students share inputs, compare responses, and build on each other's ideas, creating a dynamic record of learning across the cohort. AI becomes one contributor among many, helping the group explore possibilities, challenge assumptions, and reflect critically on emerging knowledge. I believe this approach builds creative confidence and collective critical thinking within an evolving, connected learning community."

Chris Hope, from Business Administration, uses a deliberate pause before AI is introduced into discussion activities:

"In my MBA teaching this year, when I run in-class activities, I ask that AI is not used and students force themselves to first think critically about the question or topic and discuss it with the group. After some time, I encourage the use of AI, but only to challenge and build on their perspectives. In addition, I run a debating activity where students argue a viewpoint against AI. The feedback on this approach has been remarkable, with many comments thanking me for pausing the use of AI in those discussion contexts, while also enjoying the ability to challenge and consider the importance of information literacy when debating against it."

Across these examples, Gen AI is not treated as a shortcut or a replacement for learning. Instead, students are asked to question, test, compare, and use AI with intention, and this is done within the disciplinary context in which they are building knowledge. These activities are designed to help students build the evaluative judgement and adaptive capabilities they need for study, work, and everyday life in an AI-rich world.

These activities, taken in isolation, are not solutions in themselves. However, together they show how educators can create repeated opportunities for students to question, test, compare, and use AI with intention within the disciplinary contexts in which they are building knowledge. We should not expect evaluative judgement to be developed through a single course or task. It is built gradually across a student’s whole program and continues to develop beyond graduation. Like a muscle, it is strengthened each time students are supported to critique, evaluate, question, and think for themselves. In this way, and in line with Lodge et al., these activities help students become lifelong learners who can adapt to evolving technologies, building confidence and capability over time.

Explore the Gen AI Skills Continuum practice case library

The examples shared here are part of the growing Gen AI Skills Continuum practice case library. The library showcases how educators are designing learning activities, assessments, and teaching approaches that help students use Gen AI critically, ethically, and with confidence. Importantly, each practice case makes visible how specific skills from the continuum are enacted. The cases show what Gen AI capability looks like in real teaching contexts.

We invite you to explore the library, adapt ideas to your context, and share your practice use case. Contributing a case helps build a richer picture of how educators are responding to Gen AI across disciplines and provides colleagues with practical, grounded examples to learn from.

To contribute a case of how you or your team are supporting others to develop the critical skills needed to navigate AI, fill in the required details here: https://brash-trail-0ac.notion.site/a1c88b598d6043c5a0d7d900c9873eab?pvs=105

References

  • Bearman, M., Luckin, R. (2020). Preparing University Assessment for a World with AI: Tasks for Human Intelligence. In M. Bearman, P. Dawson, R. Ajjawi, J. Tai, & D. Boud (Eds.), Re-imagining university assessment in a digital world (pp. 49–63). Springer. https://doi.org/10.1007/978-3-030-41956-1_5
  • Ke, Y., Jin, L., Ong, J. C. L., Thirunavukarasu, A. J., Car, J., Cheung, C. Y., Tham, Y. C., Ting, D. S. W., Ong, M. E. H., Compton, S., Narayan, A., Keane, P. A., Wong, T. Y., Bates, D. W., Tan, P., & Liu, N. (2026). AI-induced never-skilling in medical education. Nature Medicine, 32(6), 1997–2006. https://doi.org/10.1038/s41591-026-04438-y
  • Lodge, J. M., de Barba, P., Ainscough, L., Brazil, J. R., Broadbent, J., Ebbert, D., Frankland, S., Gabriel, F., Gašević, D., Hennicke, T., Lim, L.-A., Male, S. A., Mirriahi, N., Oliveira, E. A., Pacitti, H., Raković, M., Russell, J., Taylor-Griffiths, D., & Yang, S. (2026). Assuring quality learning in a gen AI-integrated future: The role of adaptive capabilities. Tertiary Education Quality and Standards Agency.https://www.teqsa.gov.au/sites/default/files/2026-06/assuring-quality-learning-in-a-gen-AI-integrated-future.pdf
  • Tai, J., Ajjawi, R., Boud, D., Dawson., P & Panadero, E. (2018). Developing evaluative judgement: enabling students to make decisions about the quality of work. Higher Education,76(3), 467–481. https://doi.org/10.1007/s10734-017-0220-3
21 July 2026

More GAILE blogs

aboriginal flag float-starttorres strait flag float-start

Acknowledgement of Country

RMIT University acknowledges the people of the Woi wurrung and Boon wurrung language groups of the eastern Kulin Nation on whose unceded lands we conduct the business of the University. RMIT University respectfully acknowledges their Ancestors and Elders, past and present. RMIT also acknowledges the Traditional Custodians and their Ancestors of the lands and waters across Australia where we conduct our business - Artwork 'Sentient' by Hollie Johnson, Gunaikurnai and Monero Ngarigo.

Learn more about our commitment to Indigenous cultures