Comparative analysis of generative AI models in educational exercise performance
Kein Vorschaubild vorhanden
Autor:innen
Autor:in (Körperschaft)
Publikationsdatum
2024
Typ der Arbeit
Studiengang
Typ
04B - Beitrag Konferenzschrift
Herausgeber:innen
Herausgeber:in (Körperschaft)
Betreuer:in
Übergeordnetes Werk
EDULEARN24 Proceedings
Themenheft
DOI der Originalpublikation
Link
Reihe / Serie
Reihennummer
Jahrgang / Band
Ausgabe / Nummer
Seiten / Dauer
5181-5190
Patentnummer
Verlag / Herausgebende Institution
International Academy of Technology, Education and Development (IATED)
Verlagsort / Veranstaltungsort
Palma de Mallorca
Auflage
Version
Programmiersprache
Abtretungsempfänger:in
Praxispartner:in/Auftraggeber:in
Zusammenfassung
The integration of artificial intelligence (AI) in educational settings presents great opportunities for enhancing learning experiences. Within the context of a Swiss University of applied Sciences employing a flipped classroom methodology and in class exercises, a noticeable shift in student behaviour has been observed. The quality of using generative AI for solving case study based exercises in Business Process and Project Management was analysed using OpenAI’s ChatGPT Model 3.5. However, it is unknown how the different models are performing compared to each other when solving exercises in business education. This paper aims to extend the discourse of solving class exercises by conducting a comparative analysis of various generative AI models in the context of educational exercises within the flipped classroom setting, particular in Business Process and Project Management. The study systematically assesses the performance of different AI models, such as GPT-4, BERT, BART, T5, LLM API, etc, in answering selected exercises derived from real-world business scenarios.
This study analyzes the accuracy, relevance, completeness, and contextual understanding exhibited by each AI model in response to a series of exercises. These exercises are designed to mimic real-world business challenges in Business Process and Project Management, thereby providing a meaningful evaluation of each model's use in an educational context. The study further delves into the nuances of prompt construction, examining how variations in prompt design influence the performance of AI models, thereby shedding light on the critical role of effective communication in leveraging AI for educational purposes.
The findings of this research provide educators, researchers, and practitioners with a comprehensive understanding of the comparative strengths and weaknesses of various generative AI models in the context of business education, particularly in Business Process and Project Management. By highlighting key differences in selecting and deploying AI tools for educational exercises, the paper aims to contribute insights into the optimization of AI-assisted learning environments.
Schlagwörter
Fachgebiet (DDC)
330 - Wirtschaft
Veranstaltung
Edulearn24. 16th annual International Conference on Education and New Learning Technologies
Startdatum der Ausstellung
Enddatum der Ausstellung
Startdatum der Konferenz
Enddatum der Konferenz
Datum der letzten Prüfung
ISBN
978-84-09-62938-1
ISSN
Sprache
Englisch
Während FHNW Zugehörigkeit erstellt
Ja
Zukunftsfelder FHNW
Publikationsstatus
Veröffentlicht
Begutachtung
Peer-Review der ganzen Publikation
Open Access-Status
Closed
Lizenz
Zitation
MEYER, Lukas und Achim DANNECKER, 2024. Comparative analysis of generative AI models in educational exercise performance. In: Luis GÓMEZ CHOVA, Chelo GONZÁLEZ MARTÍNEZ und Joanna LEES (Hrsg.), EDULEARN24 Proceedings. Palma de Mallorca: International Academy of Technology, Education and Development (IATED). 2024. S. 5181–5190. ISBN 978-84-09-62938-1. Verfügbar unter: https://irf.fhnw.ch/handle/11654/48333