Resources
Lists, benchmarks, datasets, software and reporting guidelines we find useful when building and evaluating biosignal AI. Select a resource to read more. Know a resource we should add? Email contact@biosignal-ai.org.
Curated lists
Good places to start: community-maintained reading lists of papers, models and tools.
-
Awesome biosignalsgithub.com/BosonHwang
A curated collection of notable AI research papers on physiological signals.
Visit Awesome biosignals (opens in a new tab) -
Awesome biosignal foundation modelsgithub.com/guxiao0822
A curated list of foundation models, datasets and tools for biosignals.
Visit Awesome biosignal foundation models (opens in a new tab)
Benchmarks
Shared, public ways to compare algorithms on the same footing.
-
Epilepsy benchmarksepilepsybenchmarks.com
An open platform for evaluating seizure detection algorithms on EEG, built around the SzCORE evaluation framework.
Visit Epilepsy benchmarks (opens in a new tab)
Open data
Repositories of recordings that researchers can request or download. Check each dataset's licence and data use terms.
-
PhysioNetphysionet.org
A long-running repository of freely available physiological and clinical datasets, with the software to work with them.
Visit PhysioNet (opens in a new tab) -
Brain Data Science Platformbdsp.io
A platform for sharing large clinical brain datasets, such as EEG and sleep recordings, for research.
Visit Brain Data Science Platform (opens in a new tab) -
TUH EEG corpusisip.piconepress.com
A large collection of clinical EEG recordings from Temple University Hospital, released with annotated subsets.
Visit TUH EEG corpus (opens in a new tab) -
OpenNeuroopenneuro.org
A free platform for sharing neuroimaging and electrophysiology datasets in a standard format.
Visit OpenNeuro (opens in a new tab)
Software
Open-source toolkits for reading, cleaning and analysing signals.
-
MNE-Pythonmne.tools
A Python package for exploring, visualising and analysing EEG and MEG data.
Visit MNE-Python (opens in a new tab) -
NeuroKit2neuropsychology.github.io
A Python toolbox for processing physiological signals such as ECG, PPG, EDA, EMG and respiration.
Visit NeuroKit2 (opens in a new tab) -
WFDB Pythonwfdb.readthedocs.io
A Python library for reading, writing and processing the waveform formats used by PhysioNet.
Visit WFDB Python (opens in a new tab)
Reporting guidelines
Checklists for reporting AI studies clearly enough to be judged and repeated, including their ethics.
-
TRIPOD+AIequator-network.org
Updated guidance for reporting clinical prediction models that use regression or machine learning.
Visit TRIPOD+AI (opens in a new tab) -
CONSORT-AIequator-network.org
Reporting guidance for clinical trials of interventions that involve artificial intelligence.
Visit CONSORT-AI (opens in a new tab) -
SPIRIT-AIequator-network.org
Guidance for writing protocols of clinical trials of interventions that involve artificial intelligence.
Visit SPIRIT-AI (opens in a new tab) -
TREGAI checklistgithub.com/nliulab
Transparent Reporting of Ethics for Generative AI: a checklist for assessing and reporting the ethical aspects of generative AI research in health care.
Visit TREGAI checklist (opens in a new tab)
Further reading
Papers and commentaries on evaluating clinical AI, and on the data and models behind biosignal AI.
-
A benchmarking crisis in biomedical machine learningNature Medicine
A short commentary on how benchmark results in biomedical machine learning can mislead.
Visit A benchmarking crisis in biomedical machine learning (opens in a new tab) -
Principles to guide clinical AI readinessNature Medicine
Principles for moving clinical AI from benchmark results to real-world evaluation.
Visit Principles to guide clinical AI readiness (opens in a new tab) -
Is AI actually improving healthcare?Nature Medicine
A commentary asking what evidence shows that clinical AI improves care.
Visit Is AI actually improving healthcare? (opens in a new tab) -
Benchmarking ECG foundation models: a reality checkarXiv
A comparison of ECG foundation models across clinical tasks, and where benchmark claims fall short.
Visit Benchmarking ECG foundation models: a reality check (opens in a new tab) -
Foundation models for biosignals: a surveyTechRxiv
A survey of foundation models for biosignals, their training objectives and downstream tasks.
Visit Foundation models for biosignals: a survey (opens in a new tab) -
PhysioNet as a global platform for biomedical researchNature Health
An account of PhysioNet, the open platform behind many public biosignal datasets.
Visit PhysioNet as a global platform for biomedical research (opens in a new tab)