Monitor AI performance with our Post-Market Surveillance tool
The RAIQC PMS Tool evaluates the ongoing performance of diagnostic AI tools, highlighting reporting discrepancies and ensuring they meet Trust expectations and AI Vendor claims.
Why do you need a PMS?
Post-market surveillance is vital in ensuring ongoing concordance between reporters and diagnostic algorithms with the RAIQC PMS Tool doing this at patient, finding, and instrument level to highlight any discrepancies, bias, or performance drift over time.
Additionally, the RAIQC PMS Tool also allows monitoring of the impact of AI on operational KPIs, such as the time from X-ray acquisition to their reporting and/or subsequent scan, or the number of cases with a suspicion of an abnormal finding flagged by AI and subsequently confirmed by secondary scan.
What does the PMS Tool monitor?
-
Concordance
How accurate is an AI tool’s output when compared to radiologists’ reports? -
Sensitivity
How well is an AI tool identifying positive findings? -
Specificity
How reliably is a tool classifying cases as being negative?
For healthcare providers
The RAIQC PMS Tool will:
-
Provide longitudinal evidencing of active surveillance of AI tools in clinical use including monitoring for bias
-
Allow measuring the impact of AI on treatment decisions and clinical outcomes
-
Offer the infrastructure by which future autonomous AI tool performance could be tracked
For AI vendors
The RAIQC PMS Tool will:
-
Generate evidence of effective PMS for regulatory bodies
-
Give the data needed to engage with healthcare providers to improve tool performance
-
Offer real world evidence to support business case and use expansion
Configurable and customisable
Designed as a vendor-neutral, platform-independent solution, the RAIQC PMS tool can be deployed on-premises or in the cloud and setup to accept data from multiple sources and systems.
