Skip Navigation Bar

NLM Announces Pill Image Recognition Challenge Winners

NLM hosted a Pill Image Recognition Challenge as part of its research and development in Computational Photography Project for Pill Identification (C3PI). Teams participating in the challenge submitted algorithms and software that will contribute to the creation of a system that can match photos taken by a smart phone to the NLM RxIMAGE database of high-resolution prescription pill images. This new system can give consumers a simple way to recognize mystery pills, help prevent unnecessary medication errors, and reduce waste by identifying pills that might otherwise be discarded.

The Pill Image Recognition Challenge responds to the increase in prescription pill use, the increased need for prescription pill management, and the challenges the public faces in the changing look of prescription pills.

Listen to Michael J. Ackerman, lead of the Pill Image Recognition Challenge, talk about what led to the challenge:

Javascript not present, please download and play the video on your device.

Video Transcript

The winners of the Pill Image Recognition Challenge are listed below. Winners were determined by mean average precision (MAP) of the submitted computer vision algorithm. The eligible submission with the highest MAP score was recommended as the first place winner, with the next two best MAP scores respectively recommended for second and third place. Winners used deep learning to achieve their results, opening new possibilities in pill image recognition for researchers.

First prize: MSU Mobile Pill Finder
Team captain: Mi Zhang, PhD
Assistant Professor, Department of Electrical and Computer Engineering, College of Engineering
Team members: Xiao Zeng, Department of Electrical and Computer Engineering
Kai Cao, PhD, Department of Computer Science and Engineering
Michigan State University

Second prize:  CASTELO (Completely Automated System to Elucidate Lozenge Origin)
Team captain: Michael Solomon
Team members: Greg Sadetsky, Ann-Julie Rhéaume

Third prize: Nikolay Khatuntsev
Pleasanton, California

The Pill Image Recognition Challenge was a National Institutes of Health (NIH) Challenge under the America COMPETES (Creating Opportunities to Meaningfully Promote Excellence in Technology, Education, and Science) Reauthorization Act of 2010 (Pub. L. 111-358).

Since its founding in 1836, the National Library of Medicine has played a pivotal role in translating biomedical research into practice and is a leader in information innovation. As one of the 27 Institutes and Centers at the National Institutes of Health, NLM advances research in biomedical informatics and data science and is the world's largest medical library. Millions of scientists, health professionals and the public use NLM services every day.