This website uses cookies primarily for visitor analytics. Certain pages will ask you to fill in contact details to receive additional information. On these pages you have the option of having the site log your details for future visits. Indicating you want the site to remember your details will place a cookie on your device. To view our full cookie policy, please click here. You can also view it at any time by going to our Contact Us page.

Researchers are developing an app that could allow self-screening for pancreatic cancer and other diseases – at the snap of a selfie.

Pancreatic cancer has one of the worst prognoses, with a five-year survival rate of 9 percent, in part because there are no tell-tale symptoms or non-invasive screening tools to catch a tumour before it spreads.

One of the earliest symptoms of the disease, as well as other diseases, is jaundice, a yellow discolouration of the skin and eyes caused by a buildup of bilirubin in the blood. The ability to detect signs of jaundice when bilirubin levels are minimally elevated – but before they’re visible to the naked eye – could enable an entirely new screening program for at-risk individuals.

In an initial clinical study of 70 people, the BiliScreen app, used with a 3-D printed box that controls the eye’s exposure to light, correctly identified cases of concern 89.7 per cent of the time, compared to the blood test currently used.

“The problem with pancreatic cancer is that by the time you’re symptomatic, it’s frequently too late,” said lead author Alex Mariakakis, a doctoral student at the Paul G. Allen School of Computer Science & Engineering from the University of Washington. “The hope is that if people can do this simple test once a month – in the privacy of their own homes – some might catch the disease early enough to undergo treatment that could save their lives.”

BiliScreen builds on earlier work from the University of Washington's Ubiquitous Computing Lab, which previously developed BiliCam, a smartphone app that screens for newborn jaundice by taking a picture of a baby’s skin. A recent study in the journal Pediatrics showed BiliCam provided accurate estimates of bilirubin levels in 530 infants.

In collaboration with UW Medicine doctors, the UbiComp lab specialises in using cameras, microphones and other components of common consumer devices, such as smartphones and tablets, to screen for disease.

The blood test that doctors currently use to measure bilirubin levels, which is typically not administered to adults unless there is reasonable cause for concern, requires access to a healthcare professional and is inconvenient for frequent screening. BiliScreen is designed to be an easy-to-use, non-invasive tool that could help determine whether someone ought to consult a doctor for further testing. Beyond diagnosis, BiliScreen could also potentially ease the burden on patients with pancreatic cancer who require frequent bilirubin monitoring.

In adults, the whites of the eyes are more sensitive than skin to changes in bilirubin levels, which can be an early warning sign for pancreatic cancer, hepatitis or the (generally harmless) Gilbert’s syndrome). Unlike skin colour, changes in the sclera are more consistent across all races and ethnicities.

Yet by the time people notice the yellowish discolouration in the sclera, bilirubin levels are already well past cause for concern. The UW team wondered if computer vision and machine learning tools could detect those colour changes in the eye before humans can see them.

“The eyes are a really interesting gateway into the body: tears can tell you how much glucose you have, sclera can tell you how much bilirubin is in your blood,” said senior author Shwetak Patel. “Our question was: could we capture some of these changes that might lead to earlier detection with a selfie?”

BiliScreen uses a smartphone’s built-in camera and flash to collect pictures of a person’s eye as they snap a selfie. The team developed a computer vision system to automatically and effectively isolate the white parts of the eye, which is a valuable tool for medical diagnostics. The app then calculates the colour information from the sclera – based on the wavelengths of light that are being reflected and absorbed – and correlates it with bilirubin levels using machine learning algorithms.

To account for different lighting conditions, the team tested BiliScreen with two different accessories: paper glasses printed with coloured squares to help calibrate colour and a 3-D printed box that blocks out ambient lighting. Using the app with the box accessory (reminiscent of a Google Cardboard headset – see closest image above) led to slightly better results.

Next steps for the research team include testing the app on a wider range of people at risk for jaundice and underlying conditions, as well as continuing to make usability improvements – including removing the need for accessories like the box and glasses.

“This relatively small initial study shows the technology has promise,” said co-author Dr. Jim Taylor, a professor in the UW Medicine Department of Pediatrics whose father died of pancreatic cancer at age 70.

“Pancreatic cancer is a terrible disease with no effective screening right now,” Taylor said. “Our goal is to have more people who are unfortunate enough to get pancreatic cancer to be fortunate enough to catch it in time to have surgery that gives them a better chance of survival.”

This research was funded by the National Science Foundation, the Coulter Foundation and endowment funds from the Washington Research Foundation.