Let the algorithm figure it out
the researchers from Stanford’s Artificial Intelligence Laboratory published a study in the journal Nature, in which they explain how they fed an algorithm images as raw pixels and associated labels, which required very little processing. "We made a very powerful machine learning algorithm that learns from data, instead of writing into computer code exactly what to look for, you let the algorithm figure it out," said co-lead author Andre Esteva.“There’s no huge dataset of skin cancer that we can just train our algorithms on, so we had to make our own,” Brett Kuprel, graduate student and co-lead author of the paper said. “We gathered images from the internet and worked with the medical school to create a nice taxonomy out of data that was very messy – the labels alone were in several languages, including German, Arabic and Latin.”
Head-to-head with 21 dermatologists
Then Stanford dermatologists and microbiology and immunology professor Helen M. Blau classified the images, resulting in 130,000 images of skin lesions representing over 2,000 different diseases. They trained a convolutional neural network, or CNN, to classify skin lesions using only pixels and disease labels as inputs, then put it head-to-head with 21 board-certified dermatologists.The testing involved biopsy-proven clinical images of the most common and deadly types of skin cancers – malignant carcinomas and melanomas– provided by the University of Edinburgh and the International Skin Imaging Collaboration Project. Tasked with identifying benign lesions and the deadly lesions, the algorithm matched the performance of the dermatologists.
“We realized it was feasible, not just to do something well, but as well as a human dermatologist,” Sebastian Thrun, an adjunct professor in the Stanford Artificial Intelligence Laboratory, said to the Stanford news site. “That’s when our thinking changed. That’s when we said, ‘Look, this is not just a class project for students, this is an opportunity to do something great for humanity.’”
Strict validation
The algorithm only exists on a computer at this moment, but they intend to put it on smartphones to bring the ability to reliably diagnose skin cancer to a large population. For that they need of strict validation -- apps that promise to detect skin cancer with the smartphone have already been the subject of FTC action -- but the researchers are hopeful that the technology could be a real option for many without access to a dermatologist.“My main Eureka moment was when I realized how ubiquitous smartphones will be,” said Esteva. “Everyone will have a supercomputer in their pockets with a number of sensors in it, including a camera. What if we could use it to visually screen for skin cancer? Or other ailments?”
