Harnessing generative AI for project management certification: developing high-quality question banks with prompt engineering
Lade...
Autor:innen
Autor:in (Körperschaft)
Publikationsdatum
2025
Typ der Arbeit
Studiengang
Typ
04B - Beitrag Konferenzschrift
Herausgeber:innen
Herausgeber:in (Körperschaft)
Betreuer:in
Übergeordnetes Werk
INTED2025 Proceedings. 19th International Technology, Education and Development Conference Valencia, Spain. 3-5 March, 2025
Themenheft
DOI der Originalpublikation
Reihe / Serie
Reihennummer
Jahrgang / Band
Ausgabe / Nummer
Seiten / Dauer
5639-5648
Patentnummer
Verlag / Herausgebende Institution
International Academy of Technology, Education and Development (IATED)
Verlagsort / Veranstaltungsort
Valencia
Auflage
Version
Programmiersprache
Abtretungsempfänger:in
Praxispartner:in/Auftraggeber:in
Zusammenfassung
The integration of generative AI into education offers transformative opportunities to streamline the creation of learning materials, particularly for certification preparation. This paper focuses on the development of a question bank tailored for the IPMA Level D Project Management certification using ChatGPT. The core of this research lies in prompt engineering, detailing how prompts were designed to extract relevant, high-quality questions from a 383-page study book comprising 29 chapters. Prompts were crafted to generate open-ended and single-choice questions with corresponding answers, including detailed explanations and references to specific page numbers in the source material.
A key aspect of this study is ensuring that the output adheres to a specific structural format compatible with Learning Management Systems (LMS) like Moodle. Questions were generated in XML format to streamline their direct integration into Moodle. This requires prompts to be carefully engineered, not only to yield content of the appropriate complexity but also to conform to the technical specifications for seamless import. This structural requirement plays a pivotal role in assessing the efficiency of using generative AI, as deviations from the required format can significantly increase post-processing time.
Prompt engineering methodology included iterative refinement to balance detail, difficulty, and style while meeting structural demands. Key insights are provided on how initial prompts were structured and adjusted based on output quality, addressing challenges such as ambiguous phrasing, misaligned references, overly simplistic questions, or format inconsistencies.
The quality of the AI-generated outputs is currently under expert review, with ongoing analyses focusing on:
- The proportion of questions requiring no or minor adjustments to content or format.
- Cases needing substantial rewriting for clarity, alignment, or adherence to the required structure.
- The number of questions deemed unsuitable for inclusion due to technical or content-related issues.
A time-based comparison is also underway to evaluate the efficiency of the generative AI approach. This involves measuring the time required for reviewing and refining AI-generated questions, including adjustments to ensure Moodle compatibility, against an estimate of the manual effort required for crafting and structuring comparable questions from scratch. Preliminary findings suggest significant time savings, especially in meeting structural requirements for LMS integration.
While this paper emphasizes the technical aspects of prompt engineering, quality assurance, and structural considerations, an outlook for future studies is provided. This includes evaluating participants' feedback on the usability and effectiveness of the question bank as a preparation tool, alongside their performance in the certification process. Metrics such as participant satisfaction, perceived usefulness, and examination outcomes will be assessed to offer deeper insights into the impact of generative AI tools in educational contexts.
The findings so far highlight the importance of expert review in ensuring both the quality and structural integrity of AI-generated content, underscoring the potential of generative AI to reduce workload while maintaining robust standards and technical compatibility for certification materials.
Schlagwörter
Fachgebiet (DDC)
Veranstaltung
19th International Technology, Education and Development Conference
Startdatum der Ausstellung
Enddatum der Ausstellung
Startdatum der Konferenz
03.03.2025
Enddatum der Konferenz
05.03.2025
Datum der letzten Prüfung
ISBN
978-84-09-70107-0
ISSN
Sprache
Englisch
Während FHNW Zugehörigkeit erstellt
Ja
Zukunftsfelder FHNW
Publikationsstatus
Veröffentlicht
Begutachtung
Peer-Review der ganzen Publikation
Open Access-Status
Closed
Lizenz
Zitation
Meyer, L., & Dannecker, A. (2025). Harnessing generative AI for project management certification: developing high-quality question banks with prompt engineering. INTED2025 Proceedings. 19th International Technology, Education and Development Conference Valencia, Spain. 3-5 March, 2025, 5639–5648. https://doi.org/10.21125/inted.2025.1440