Smart tools, smarter students. A study on ChatGPT's effects on learning outcomes and exercise quality in business education

Loading...
Thumbnail Image
Author (Corporation)
Publication date
2024
Typ of student thesis
Course of study
Type
04B - Conference paper
Editor (Corporation)
Supervisor
Parent work
INTED2024 Proceedings
Special issue
DOI of the original publication
Link
Series
Series number
Volume
Issue / Number
Pages / Duration
2704-2713
Patent number
Publisher / Publishing institution
IATED
Place of publication / Event location
Valencia
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
In education, there's a growing interest in using artificial intelligence, particularly large language models (LLM) such as ChatGPT, to assist and improve learning. Within the context of a Swiss University of applied Sciences employing a flipped classroom methodology and in class exercises, a noticeable shift in student behaviour has been observed. Students overly rely on these tools to complete exercises, diverting their focus away from the exercise content and goals, leading to a decline in the quality of outcomes. It is suspected that they often lack the essential skills to critically assess information accuracy of AI responses and contextualize it within the educational exercise. This paper aims to evaluate the implications of employing ChatGPT in educational exercises. We aim to assess ChatGPT's proficiency in solving such exercises and to illustrate the knowledge prerequisites for formulating effective prompts. We focus on bachelor students in business education, particularly in project management and business process management. For instance, we will analyse various types of prompts and the resulting outcomes from a project planning exercise conducted by students based on an interview with the project sponsor. The research methodology involves an analysis of the results obtained, emphasising on the impact on the learning process. This study aims to review the viability of ChatGPT as a tool for solving educational exercises. Additionally, we investigate potential shortcomings and explore required prompts necessary for achieving good outcomes. Moreover, we examine the broader implications of utilising ChatGPT in educational contexts, reflecting on its effects on the learning process. Specifically, exploring ways educators can enhance student learning through effective exercises with the increasing utilisation of AI in the classroom. This study contributes to the ongoing dialogue on using AI in education by offering insights into the challenges and opportunities associated with ChatGPT's role in solving educational exercises. By addressing the quality of prompts and the subsequent impact on learning, we aim to provide practical guidance for educators and researchers seeking to harness the potential of AI in educational settings.
Keywords
Project
Event
18th International Technology, Education and Development Conference
Exhibition start date
Exhibition end date
Conference start date
04.03.2024
Conference end date
06.03.2024
Date of the last check
ISBN
978-84-09-59215-9
ISSN
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
Peer review of the complete publication
Open access category
Closed
License
Citation
Meyer, L., & Dannecker, A. (2024). Smart tools, smarter students. A study on ChatGPT’s effects on learning outcomes and exercise quality in business education. In L. Gómez Chova, C. González Martínez, & J. Lees (Eds.), INTED2024 Proceedings (pp. 2704–2713). IATED. https://doi.org/10.21125/inted.2024.0743