Monitor AI performance with RAIQC AIM
The RAIQC AIM tool monitors and evaluates the performance of diagnostic AI tools on an ongoing basis, highlighting reporting discrepancies and ensuring they meet Trust expectations and AI Vendor claims.
Why do you need AI monitoring?
Monitoring, or post-market surveillance, is vital in ensuring AI tools continue to perform safely and effectively after deployment.
Built in line with national guidance from the Royal College of Radiologists, RAIQC AIM provides an ongoing oversight of AI performance at patient, finding, and instrument level to highlight any discrepancies, bias, or performance drift over time.
The tool also allows monitoring of the impact of diagnostic AI on operational KPIs, such as the time from X-ray acquisition to follow-up; downstream investigations triggered by AI findings; and changes in detection and reporting patterns.
What does the AIM tool monitor?
-
Concordance
How accurate is an AI tool’s output when compared to radiologists’ reports? -
Sensitivity
How well is an AI tool identifying positive findings? -
Specificity
How reliably is a tool classifying cases as being negative? -
Deviation
Is performance consistent over time? Is there evidence of unexpected AI behaviour?
For healthcare providers
The RAIQC AIM tool:
-
Offers longitudinal evidencing of active surveillance of AI tools in clinical use including monitoring for bias
-
Allows measuring the impact of AI on treatment decisions and clinical outcomes
-
Aligns with national best practice guidance, including recommendations from the Royal College of Radiologists
-
Provides the infrastructure to support future autonomous diagnostic AI deployment
For AI vendors
The tool:
-
Supports regulatory and post-deployment requirements
-
Gives assurance of ongoing safety and performance in clinical environments
-
Provides the data needed to engage with healthcare providers to improve tool performance
-
Offers real-world evidence to support business case and use expansion
Configurable and customisable
Designed as a vendor-neutral, platform-independent solution, the RAIQC AIM tool can be deployed on-premises or in the cloud and setup to accept data from multiple sources and systems.
