VizGroup: An AI-Assisted Event-Driven System for Real-Time Collaborative Programming Learning Analytics

• Main Authors: Tang, Xiaohang, Wong, Sam, Pu, Kevin, Chen, Xi, Yang, Yalong, Chen, Yan
• Format: Journal Article
• Language: English
• Published: 12-04-2024
• Subjects: Computer Science - Human-Computer Interaction
• DOI: 10.48550/arxiv.2404.08743

Programming instructors often conduct collaborative learning activities, like
Peer Instruction, to foster a deeper understanding in students and enhance
their engagement with learning. These activities, however, may not always yield
productive outcomes due to the diversity of student mental models and their
ineffective collaboration. In this work, we introduce VizGroup, an AI-assisted
system that enables programming instructors to easily oversee students'
real-time collaborative learning behaviors during large programming courses.
VizGroup leverages Large Language Models (LLMs) to recommend event
specifications for instructors so that they can simultaneously track and
receive alerts about key correlation patterns between various collaboration
metrics and ongoing coding tasks. We evaluated VizGroup with 12 instructors in
a comparison study using a dataset collected from a Peer Instruction activity
that was conducted in a large programming lecture. The results showed that
VizGroup helped instructors effectively overview, narrow down, and track
nuances throughout students' behaviors.