E2P Simulator: an open-source tool for interpreting the practical significance of research findings #26
Description
Title
E2P Simulator: an open-source tool for interpreting the practical significance of research findings
Name of the tutor(s)
Povilas Karvelis
Expected duration
30 min
Recording Consent
Yes
Required skills
Intermediate
Programming Language
JavaScript, HTML
Tags
Predictive modelling; Translational neuroscience; Practical significance; Web-based tools;
Image/Logo for the OHBM Train Track website
No response
Short description
Researchers focus too much on statistical significance and have really bad intuitions about the practical significance of research findings. That is why the decades of neuroscience research has had so little impact on mental health care, in my humble opinion. To address this, I have developed E2P Simulator: an interactive, open-source, web-based tool that translates standard effect sizes into predictive utility metrics. It visually and quantitatively demonstrates the relationship between commonly reported statistical metrics (such as Cohen’s d and Pearson’s r) and predictive metrics (such as AUC. PR-AUC and Net Benefit), while accounting for real-world factors like measurement reliability and outcome base rates. Much like how power analysis tools (such as G*Power) help researchers plan for statistical significance, I have developed E2P Simulator, which plan for practical significance.
Please read and follow the OHBM Code of Conduct
- I agree to follow the OHBM Code of Conduct during the hackathon