25gmds067 10.3205/25gmds067 urn:nbn:de:0183-25gmds0670 Meeting Abstract Stahl Stahl Henrik H

University of Applied Sciences Darmstadt (h_da), Darmstadt, Germany

author Klein Klein Lukas L

University of Applied Sciences Darmstadt (h_da), Darmstadt, Germany

author Grieser Grieser Gunter G

University of Applied Sciences Darmstadt (h_da), Darmstadt, Germany

author Jahn Jahn Antje A

University of Applied Sciences Darmstadt (h_da), Darmstadt, Germany

author Götte Götte Heiko H

Merck Healthcare KGaA, Darmstadt, Germany

author German Medical Science GMS Publishing House

Düsseldorf

610 subgroup identification bias correction ABC machine learning 20251103 engl This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. Dieser Artikel ist ein Open-Access-Artikel und steht unter den Lizenzbedingungen der Creative Commons Attribution 4.0 License (Namensnennung). M0631 067 Deutsche Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie 70. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS) V: Machine learning and AI applications 1 Jena 20250907 20250911 Abstr. 291 TextPersonalized medicine is a crucial aspect in finding effective treatments for patients. In clinical development it is essential to identify subgroups of patients who exhibit a beneficial treatment effect, ideally before moving to confirmatory trials. The identified subgroups could be defined by predictive biomarkers with corresponding cut-off values. However, once biomarkers or corresponding cut-offs are selected in a data-driven manner a selection bias is introduced, i.e. the treatment effect within the selected subgroup is overestimated.In previous work, the approximate Bayesian computation (ABC) algorithm was utilized to correct for this selection bias . This approach rather covers a reduced range of potential subgroups that are defined by cut-off values. Machine learning (ML)-based subgroup identification methods allow to cover much more potential subgroups with the downside of even greater bias and less interpretable subgroup definitions. Our goal is to extend the ABC algorithm to correct for selection bias also in these situations. Since our research is motivated by clinical trials in oncology, we will focus on time-to-event data such as overall survival or progression-free survival time.ABC is a simulation approach that selects simulation runs where some particular statistic calculated from trial data at hand is similar to that calculated from simulated data where the true treatment effects are known. The true treatment effects from the selected simulation runs then define an approximation of their posterior distribution that is used for bias correction. Compared to ML methods raise additional questions that makes an extension not straight forward: The higher the complexity of the ML approach is the less comparable are the subgroup definitions between the simulation runs. Therefore, next to bias correction also “overlap with true subgroup”, “rate of correct biomarker inclusion” and “similarity in subgroup size” has to be assessed. Depending on the underlying goal of the ML algorithm there is also a higher or lower inherent tendency for bias and a methods potential for correcting that bias needs to be traded off against its potential to identify the “right” patients.All those aspects are investigated in simulation studies based on the ADEMP framework. We start with two approaches: model-based partitioning (MOB) , , as an ML approach and use LASSO regression with treatment interactions as a comparator. In both approaches ABC is investigated for correcting selection bias.The authors declare that they have no competing interests.The authors declare that an ethics committee vote is not required. Götte H Kirchner M Kieser M Adjustment for exploratory cut-off selection in randomized clinical trials with survival endpoint 2020 Biom J 627-642 Götte H, Kirchner M, Kieser M. Adjustment for exploratory cut-off selection in randomized clinical trials with survival endpoint. Biom J. 2020 May;62(3):627-642. DOI: 10.1002/bimj.201800302 http://dx.doi.org/10.1002/bimj.201800302 Lipkovich I Dmitrienko A B R D'Agostino Sr Tutorial in biostatistics: data-driven subgroup identification and analysis in clinical trials 2017 Stat Med 136-196 Lipkovich I, Dmitrienko A, B R D'Agostino Sr. Tutorial in biostatistics: data-driven subgroup identification and analysis in clinical trials. Stat Med. 2017 Jan 15;36(1):136-196. DOI: 10.1002/sim.7064 http://dx.doi.org/10.1002/sim.7064 Zeileis A Hothorn T Hornik K Model-based recursive partitioning 2008 Journal of Computational and Graphical Statistics 492–514 Zeileis A, Hothorn T, Hornik K. Model-based recursive partitioning. Journal of Computational and Graphical Statistics. 2008;17(2):492–514. DOI: 10.1198/106186008X319331 http://dx.doi.org/10.1198/106186008X319331 Seibold H Zeileis A Hothorn T Model-Based Recursive Partitioning for Subgroup Analyses 2016 Int J Biostat 45-63 Seibold H, Zeileis A, Hothorn T. Model-Based Recursive Partitioning for Subgroup Analyses. Int J Biostat. 2016 May 1;12(1):45-63. DOI: 10.1515/ijb-2015-0032 http://dx.doi.org/10.1515/ijb-2015-0032 Sun S Sechidis K Chen Y Lu J Ma C Mirshani A Ohlssen D Vandemeulebroecke M Bornkamp B Comparing algorithms for characterizing treatment effect heterogeneity in randomized trials 2024 Biom J e2100337 Sun S, Sechidis K, Chen Y, Lu J, Ma C, Mirshani A, Ohlssen D, Vandemeulebroecke M, Bornkamp B. Comparing algorithms for characterizing treatment effect heterogeneity in randomized trials. Biom J. 2024 Jan;66(1):e2100337. DOI: 10.1002/bimj.202100337 http://dx.doi.org/10.1002/bimj.202100337 0 0 0 0