Predicting engagement in computer-supported collaborative learning groups using natural language processing
No Thumbnail Available
Authors
Author (Corporation)
Publication date
20.03.2024
Typ of student thesis
Course of study
Type
06 - Presentation
Editors
Editor (Corporation)
Supervisor
Parent work
Special issue
DOI of the original publication
Series
Series number
Volume
Issue / Number
Pages / Duration
Patent number
Publisher / Publishing institution
Place of publication / Event location
Regensburg
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
Collaborative group engagement is a key factor of success in learning groups. This work explores the development of an innovative natural language processing method for predicting collaborative group engagement. To this end, we identified linguistic markers based on an established observation-based scheme for rating collaborative group engagement, such as, semantic similarity to task instructions, verbal mimicry, sentiment, and use of jargon. We evaluated the predictive power of the linguistic markers on the data of an observational study in which 38 learning groups were instructed to perform a collaborative learning task. Overall, the data consisted of 2588 expert ratings on collaborative group engagement. We relied on machine learning to the predict collaborative group engagement ratings using informative subsets of linguistic markers. The results showed above-baseline predictive accuracy for all four dimensions of collaborative group engagement. Moreover, the analysis of feature importance points to quantity of utterances, responsiveness and uniformity of participation as the most important markers for collaborative group engagement. By harnessing natural language processing, this work extends traditional qualitative analysis and delivers nuanced quantitative metrics suitable for capturing the complexity and dynamics of contemporary Computer Supported Collaborative Learning (CSCL) environments. Thereby, it contributes to the evolving landscape of CSCL research and demonstrates the potential of novel analytic techniques to support and enrich qualitative analysis in multiple domains.
Keywords
Natural Language Processing, Collaborative Group Engagement, Computer-supported collaborative learning
Subject (DDC)
150 - Psychologie
Event
TeaP 2024 Tagung experimentell arbeitender Psycholog:innen
Exhibition start date
Exhibition end date
Conference start date
17.03.2024
Conference end date
20.03.2024
Date of the last check
ISBN
ISSN
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Review
No peer review
Open access category
License
Citation
JEITZINER, Loris Tizian, Lisa PANETH, Oliver RACK, Carmen ZAHN und Dirk WULFF, 2024. Predicting engagement in computer-supported collaborative learning groups using natural language processing. TeaP 2024 Tagung experimentell arbeitender Psycholog:innen. Regensburg. 20 März 2024. Verfügbar unter: https://irf.fhnw.ch/handle/11654/46073