Training and re-using human experience: a recommender for more accurate cost estimates in project planning

Abstract

In many industries, companies deliver customised solutions to their (business) customers within projects. Estimating the human effort involved in such projects is a difficult task and underestimating efforts can lead to non-billable hours, i.e. financial loss on the side of the solution provider. Previous work in this area has focused on automatic estimation of the cost of software projects and has largely ignored the interaction between automated estimation support and human project leads. Our main hypothesis is that an adequate design of such interaction will increase the acceptance of automatically derived estimates and that it will allow for a fruitful combination of data-driven insights and human experience. We therefore build a recommender that is applicable beyond software projects and that suggests job positions to be added to projects and estimated effort of such positions. The recommender is based on the analysis of similar cases (case-based reasoning), "explains" derived similarities and allows human intervention to manually adjust the outcomes. Our experiments show that recommendations were considered helpful and that the ability of the system to explain and adjust these recommendations was heavily used and increased the trust in the system. We conjecture that the interaction of project leads with the system will help to further improve the accuracy of recommendations and the support of human learning in the future.