Conference paper 2025

ZoneSight: Generative AI for Assessing Practical Competency in Project-Based and Apprenticeship Learning Environments

IEEE Global Engineering Education Conference, EDUCON
Conference
Abstract

Traditional assessment methods struggle to authentically capture the practical application of competencies in complex learning environments such as SEL (Social-Emotional Learning) and CTE (Career and Technical Education). These fields require tools that go beyond self-reports or structured written assessments, which often miss the nuanced, context-driven ways students demonstrate skills. ZoneSight leverages generative AI to perform deep contextual analysis on unstructured data like audio and video, allowing for a richer, more flexible assessment of competencies that more closely reflect the authentic learning, while also introducing more objectivity and scalability to assessments in these fields. This paper presents early progress and preliminary results from ZoneSight, a tool designed to address this challenge by analyzing real interactions to extract insights into nuanced competencies, beginning with SEL. ZoneSight's scalable, psychometrically sound assessments align with the dynamic nature of SEL (current focus) and hold future potential for application in CTE environments. © 2025 IEEE.

Keywords

Author Keywords

educational technology competency assessment psychometric validity scalable assessment skills-based assessment social-emotional learning

Index Keywords

Engineering education Students Project based learning Computer aided instruction Technical educations Educational technology Learning environments social behavior Competency assessment Apprenticeship learning Emotional learning Psychometric validity Scalable assessment Skill-based assessment Social-emotional learning
Author Affiliations
Program Department, The Possible Zone, Boston, MA, United States
Funding & Acknowledgements
No funding information
References 10 References
1 Handbook of Social and Emotional Learning Research and Practice, (2015)
2 Evidence Base for how We Learn Supporting Students Social Emotional and Academic Development, (2017)
3 Gresham, Frank M., Psychometric Fundamentals of the Social Skills Improvement System: Social–Emotional Learning Edition Rating Forms, Assessment for Effective Intervention, 45, 3, pp. 194-209, (2020)
4 Yates, Natasha, Self-assessment: With all its limitations, why are we still measuring and teaching it? Lessons from a scoping review, Medical Teacher, 44, 11, pp. 1296-1302, (2022)
5 Duckworth, Angela Lee, Measurement Matters: Assessing Personal Qualities Other Than Cognitive Ability for Educational Purposes, Educational Researcher, 44, 4, pp. 237-251, (2015)
6 Yusop, Siti Raudhah M., An Assessment Approaches and Learning Outcomes in Technical and Vocational Education: A Systematic Review Using PRISMA, Sustainability (Switzerland), 14, 9, (2022)
7 Savin-Baden, Maggi, Understanding the impact of assessment on students in problem-based learning, Innovations in Education and Teaching International, 41, 2, pp. 223-233, (2004)
8 Van Der Vleuten, Cees P.M., Assessment in the context of problem-based learning, Advances in Health Sciences Education, 24, 5, pp. 903-914, (2019)
9 Possible Zone, (2022)
10 Gordon, Morris A., Non-technical skills assessments in undergraduate medical education: A focused BEME systematic review: BEME Guide No. 54, Medical Teacher, 41, 7, pp. 732-745, (2019)
Quick Actions
Full Text via DOI
Citation Metrics
0
Times Cited (Scopus)

References 10
Document Identifiers