RWD-Cockpit: application for quality assessment of real-world data

Type
01A - Journal article
Editors
Editor (Corporation)
Supervisor
Parent work
JMIR Formative Research
Special issue
DOI of the original publication
Link
Series
Series number
Volume
6
Issue / Number
10
Pages / Duration
Patent number
Publisher / Publishing institution
JMIR Publications
Place of publication / Event location
Edition
Version
Programming language
Assignee
Practice partner / Client
Abstract
Background: Digital technologies are transforming the health care system. A large part of information is generated as real-world data (RWD). Data from electronic health records and digital biomarkers have the potential to reveal associations between the benefits and adverse events of medicines, establish new patient-stratification principles, expose unknown disease correlations, and inform on preventive measures. The impact for health care payers and providers, the biopharmaceutical industry, and governments is massive in terms of health outcomes, quality of care, and cost. However, a framework to assess the preliminary quality of RWD is missing, thus hindering the conduct of population-based observational studies to support regulatory decision-making and real-world evidence. Objective: To address the need to qualify RWD, we aimed to build a web application as a tool to translate characterization of some quality parameters of RWD into a metric and propose a standard framework for evaluating the quality of the RWD. Methods: The RWD-Cockpit systematically scores data sets based on proposed quality metrics and customizable variables chosen by the user. Sleep RWD generated de novo and publicly available data sets were used to validate the usability and applicability of the web application. The RWD quality score is based on the evaluation of 7 variables: manageability specifies access and publication status; complexity defines univariate, multivariate, and longitudinal data; sample size indicates the size of the sample or samples; privacy and liability stipulates privacy rules; accessibility specifies how the data set can be accessed and to what granularity; periodicity specifies how often the data set is updated; and standardization specifies whether the data set adheres to any specific technical or metadata standard. These variables are associated with several descriptors that define specific characteristics of the data set. Results: To address the need to qualify RWD, we built the RWD-Cockpit web application, which proposes a framework and applies a common standard for a preliminary evaluation of RWD quality across data sets—molecular, phenotypical, and social—and proposes a standard that can be further personalized by the community retaining an internal standard. Applied to 2 different case studies—de novo–generated sleep data and publicly available data sets—the RWD-Cockpit could identify and provide researchers with variables that might increase quality Conclusions: The results from the application of the framework of RWD metrics implemented in the RWD-Cockpit application suggests that multiple data sets can be preliminarily evaluated in terms of quality using the proposed metrics. The output scores—quality identifiers—provide a first quality assessment for the use of RWD. Although extensive challenges remain to be addressed to set RWD quality standards, our proposal can serve as an initial blueprint for community efforts in the characterization of RWD quality for regulated settings.
Keywords
Subject (DDC)
330 - Wirtschaft
Project
Event
Exhibition start date
Exhibition end date
Conference start date
Conference end date
Date of the last check
ISBN
ISSN
2561-326X
Language
English
Created during FHNW affiliation
Yes
Strategic action fields FHNW
Publication status
Published
Review
Peer review of the complete publication
Open access category
Gold
License
'https://creativecommons.org/licenses/by/4.0/'
Citation
BABRAK, Lmar, Erand SMAKAJ, Teyfik AGAC, Petra ASPRION, Frank GRIMBERG, Daan VAN DER WERF, Erwin Willem VAN GINKEL, Deniz David TOSONI, Ieuan CLAY, Markus DEGEN, Dominique BRODBECK, Eriberto Noel NATALI, Erik SCHKOMMODAU und Enkelejda MIHO, 2022. RWD-Cockpit: application for quality assessment of real-world data. JMIR Formative Research. 2022. Bd. 6, Nr. 10. DOI 10.2196/29920. Verfügbar unter: https://doi.org/10.26041/fhnw-7264