Harnessing generative AI for project management certification: developing high-quality question banks with prompt engineering
Loading...
Authors
Author (Corporation)
Publication date
2025
Typ of student thesis
Course of study
Collections
Type
04B - Conference paper
Editors
Editor (Corporation)
Supervisor
Parent work
INTED2025 Proceedings. 19th International Technology, Education and Development Conference Valencia, Spain. 3-5 March, 2025
Special issue
DOI of the original publication
Series
Series number
Volume
Issue / Number
Pages / Duration
5639-5648
Patent number
Publisher / Publishing institution
International Academy of Technology, Education and Development (IATED)
Place of publication / Event location
Valencia
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
The integration of generative AI into education offers transformative opportunities to streamline the creation of learning materials, particularly for certification preparation. This paper focuses on the development of a question bank tailored for the IPMA Level D Project Management certification using ChatGPT. The core of this research lies in prompt engineering, detailing how prompts were designed to extract relevant, high-quality questions from a 383-page study book comprising 29 chapters. Prompts were crafted to generate open-ended and single-choice questions with corresponding answers, including detailed explanations and references to specific page numbers in the source material.
A key aspect of this study is ensuring that the output adheres to a specific structural format compatible with Learning Management Systems (LMS) like Moodle. Questions were generated in XML format to streamline their direct integration into Moodle. This requires prompts to be carefully engineered, not only to yield content of the appropriate complexity but also to conform to the technical specifications for seamless import. This structural requirement plays a pivotal role in assessing the efficiency of using generative AI, as deviations from the required format can significantly increase post-processing time.
Prompt engineering methodology included iterative refinement to balance detail, difficulty, and style while meeting structural demands. Key insights are provided on how initial prompts were structured and adjusted based on output quality, addressing challenges such as ambiguous phrasing, misaligned references, overly simplistic questions, or format inconsistencies.
The quality of the AI-generated outputs is currently under expert review, with ongoing analyses focusing on:
- The proportion of questions requiring no or minor adjustments to content or format.
- Cases needing substantial rewriting for clarity, alignment, or adherence to the required structure.
- The number of questions deemed unsuitable for inclusion due to technical or content-related issues.
A time-based comparison is also underway to evaluate the efficiency of the generative AI approach. This involves measuring the time required for reviewing and refining AI-generated questions, including adjustments to ensure Moodle compatibility, against an estimate of the manual effort required for crafting and structuring comparable questions from scratch. Preliminary findings suggest significant time savings, especially in meeting structural requirements for LMS integration.
While this paper emphasizes the technical aspects of prompt engineering, quality assurance, and structural considerations, an outlook for future studies is provided. This includes evaluating participants' feedback on the usability and effectiveness of the question bank as a preparation tool, alongside their performance in the certification process. Metrics such as participant satisfaction, perceived usefulness, and examination outcomes will be assessed to offer deeper insights into the impact of generative AI tools in educational contexts.
The findings so far highlight the importance of expert review in ensuring both the quality and structural integrity of AI-generated content, underscoring the potential of generative AI to reduce workload while maintaining robust standards and technical compatibility for certification materials.
Keywords
Subject (DDC)
Event
19th International Technology, Education and Development Conference
Exhibition start date
Exhibition end date
Conference start date
03.03.2025
Conference end date
05.03.2025
Date of the last check
ISBN
978-84-09-70107-0
ISSN
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
Peer review of the complete publication
Open access category
Closed
License
Citation
Meyer, L., & Dannecker, A. (2025). Harnessing generative AI for project management certification: developing high-quality question banks with prompt engineering. INTED2025 Proceedings. 19th International Technology, Education and Development Conference Valencia, Spain. 3-5 March, 2025, 5639–5648. https://doi.org/10.21125/inted.2025.1440