1. Conferences Overview
    2. Gesundheit gestalten
    3. Developing the GRRAS-COSMIN reporting guidelines for studies on reliability and agreement/measurement error
Logo

Gesundheit gestalten

Deutsche Gesellschaft für Allgemeinmedizin und Familienmedizin (DEGAM), Deutsche Gesellschaft für Sozialmedizin und Prävention (DGSMP), Netzwerk Evidenzbasierte Medizin e.V. (EbM), Deutsche Gesellschaft für Medizinische Soziologie (DGMS)
30.09.2026-02.10.2026
Göttingen

Meeting Abstract

Developing the GRRAS-COSMIN reporting guidelines for studies on reliability and agreement/measurement error

Merle-Marie Pittelkow - Charité – Universitätsmedizin Berlin, Institute of Clinical Nursing Science, Berlin, Deutschland
Maximilian Mönch - Charité – Universitätsmedizin Berlin, Institute of Biometry and Clinical Epidemiology, Berlin, Deutschland
Lidwine B. Mokkink - Amsterdam UMC, Vrije Universiteit Amsterdam, Department of Epidemiology and Data Science, Amsterdam, Niederlande; Amsterdam Public Health research institute, Methodology, Amsterdam, Niederlande
David L. Streiner - McMaster University, Department of Psychiatry and Behavioural Neurosciences, Deutschland
Stig Brorson - University of Copenhagen, Centre for Evidence-Based Orthopaedics, Zealand University Hospital and Department of Clinical Medicine, Dänemark
Mohamed Shoukri - King Faisal Specialist Hospital and Research Centre, Biostatistics and Scientific Computing Department, Saudi-Arabien; University of Western Ontario, Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, Kanada
Jan Kottner - Charité – Universitätsmedizin Berlin, Institute of Clinical Nursing Science, Berlin, Deutschland

Text

Background: Reliability and agreement/measurement error are essential measurement properties and directly affect research quality and thereby evidence-based clinical practice. The Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were developed to improve reporting completeness and transparency. Given methodological advances over the past decade, an update aligned with current standards, including the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN), is needed.

Aim/scientific question: As a first step, we aim to identify and synthesize published critiques, evaluations, and methodological discussions to inform the updated GRRAS-COSMIN reporting guideline.

Material & Methods: The methods review is registered https://doi.org/10.17605/OSF.IO/9TJEX. We included publications citing the original GRRAS that provide critiques or suggestions, and studies, reviews, editorials, and guidance documents from the past decade addressing methodological aspects of reliability, agreement, or measurement error. Included sources are analyzed using qualitative content analysis and hybrid codebook thematic analysis.

Results: We included 19 publications commenting on GRRAS and 133 papers addressing methodological aspects of reliability, agreement, or measurement error. An additional 15 key sources were identified by the author team, resulting in 148 included sources. Data analysis is ongoing and additional key sources may be identified via backwards searching. By September 2026, we expect results on the measurement properties (i.e., definitions), key methodological issues (e.g., study design, statistical methods, handling of measurement error, risk of bias, reporting quality), and use of existing frameworks. Further inductive themes may be developed during analysis.

Discussion: Transparent reporting supports both accurate reporting and robust study design when considered early. The updated GRRAS-COSMIN guideline will enhance reproducibility and facilitate critical appraisal in studies of reliability, agreement/measurement error.

Take Home Message: The updated GRRAS-COSMIN guideline will provide practical, up-to-date guidance to improve reporting of studies on reliability and agreement/measurement error for measurement instruments in health sciences.

Competing interests: Keine