A major milestone for the treatment of eye disease
We are delighted to announce the results of the first phase of our joint research partnership with Moorfields Eye Hospital, which could potentially transform the management of sight-threatening eye disease.
The results, published online in Nature Medicine (open access full text, see end of blog), show that our AI system can quickly interpret eye scans from routine clinical practice with unprecedented accuracy. It can correctly recommend how patients should be referred for treatment for over 50 sight-threatening eye diseases as accurately as world-leading expert doctors.
These are early results, but they show that our system could handle the wide variety of patients found in routine clinical practice. In the long term, we hope this will help doctors quickly prioritise patients who need urgent treatment – which could ultimately save sight.
A more streamlined process
Currently, eyecare professionals use optical coherence tomography (OCT) scans to help diagnose eye conditions. These 3D images provide a detailed map of the back of the eye, but they are hard to read and need expert analysis to interpret.
The time it takes to analyse these scans, combined with the sheer number of scans that healthcare professionals have to go through (over 1,000 a day at Moorfields alone), can lead to lengthy delays between scan and treatment – even when someone needs urgent care. If they develop a sudden problem, such as a bleed at the back of the eye, these delays could even cost patients their sight.
The system we have developed seeks to address this challenge. Not only can it automatically detect the features of eye diseases in seconds, but it can also prioritise patients most in need of urgent care by recommending whether they should be referred for treatment. This instant triaging process should drastically cut down the time elapsed between the scan and treatment, helping sufferers of diabetic eye disease and age-related macular degeneration avoid sight loss.
What our research shows...
Adaptable technology
We don’t just want this to be an academically interesting result – we want it to be used in real treatment. So our paper also takes on one of the key barriers for AI in clinical practice: the “black box” problem. For most AI systems, it’s very hard to understand exactly why they make a recommendation. That’s a huge issue for clinicians and patients who need to understand the system’s reasoning, not just its output – the why as well as the what.
Our system takes a novel approach to this problem, combining two different neural networks with an easily interpretable representation between them. The first neural network, known as the segmentation network, analyses the OCT scan to provide a map of the different types of eye tissue and the features of disease it sees, such as haemorrhages, lesions, irregular fluid or other symptoms of eye disease. This map allows eyecare professionals to gain insight into the system’s “thinking.” The second network, known as the classification network, analyses this map to present clinicians with diagnoses and a referral recommendation. Crucially, the network expresses this recommendation as a percentage, allowing clinicians to assess the system’s confidence in its analysis.
This functionality is critically important, since eyecare professionals are always going to play a key role in deciding the type of care and treatment a patient receives. Enabling them to scrutinise the technology’s recommendations is key to making the system usable in practice.
On top of this, our technology can be easily applied to different types of eye scanners, and not just the specific type of device it was trained on at Moorfields. This might seem inconsequential, but it means that the technology could be applied across the world with relative ease, massively increasing the number of patients who could potentially benefit. This also ensures the system can still be used in hospitals and other clinical settings even as OCT scanners are upgraded or replaced over time.
How our model works...
The next phase
While we’re incredibly proud of this progress, this initial research [PDF] would need to be turned into a product and then undergo rigorous clinical trials and regulatory approval before being used in practice. But we’re confident that, in time, this system could transform the diagnosis, treatment and management of eye disease.
Our partners at Moorfields want our research to help them improve care, reduce some of the strain on clinicians, and lower costs - all at the same time. So we’ve also worked hard on what comes next.
If this technology is validated for general use by clinical trials, Moorfields’ clinicians will be able to use it for free across all 30 of their UK hospitals and community clinics, for an initial period of five years. These clinics serve 300,000 patients a year and receive over 1,000 OCT scan referrals every day – each of which could benefit from improved accuracy and speed of diagnosis.
We’re also proud that the work we’ve put into this project will help accelerate many other NHS research efforts. The original dataset held by Moorfields was suitable for clinical use, but not for machine learning research. So we’ve invested significantly in cleaning up, curating and labelling the dataset to create one of the best AI-ready databases for eye research in the world.
This improved database is owned by Moorfields as a non-commercial public asset, and it’s already been used by hospital researchers for nine separate studies into a wide range of conditions - with many more to come. Moorfields can also use DeepMind’s trained AI model for their future non-commercial research efforts.
For all of us who have worked on this since we signed our agreement with Moorfields in 2016, this is a hugely exciting milestone, and another indication of what is possible when clinicians and technologists work together. We’ll continue to keep you updated as we make progress.