Article Information
Group Information: The CAMELYON16 Consortium authors and collaborators are listed at the end of this
article.
Accepted for Publication: October 26, 2017.
Corresponding Author: Babak Ehteshami Bejnordi, MS, Radboud University Medical Center, Postbus 9101, 6500
HB Nijmegen (
ehteshami@
123456babakint.com
).
The CAMELYON16 Consortium Authors: Meyke Hermsen, BS; Quirine F Manson, MD, MS; Maschenka Balkenhol, MD, MS; Oscar Geessink,
MS; Nikolaos Stathonikos, MS; Marcory CRF van Dijk, MD, PhD; Peter Bult, MD, PhD;
Francisco Beca, MD, MS; Andrew H Beck, MD, PhD; Dayong Wang, PhD; Aditya Khosla, PhD;
Rishab Gargeya; Humayun Irshad, PhD; Aoxiao Zhong, BS; Qi Dou, MS; Quanzheng Li, PhD;
Hao Chen, PhD; Huang-Jing Lin, MS; Pheng-Ann Heng, PhD; Christian Haß, MS; Elia Bruni,
PhD; Quincy Wong, BS, MBA; Ugur Halici, PhD; Mustafa Ümit Öner, MS; Rengul Cetin-Atalay,
MD; Matt Berseth, MS; Vitali Khvatkov, MS; Alexei Vylegzhanin, MS; Oren Kraus, MS;
Muhammad Shaban, MS; Nasir Rajpoot, PhD; Ruqayya Awan, MS; Korsuk Sirinukunwattana,
PhD; Talha Qaiser, BS; Yee-Wah Tsang, MD; David Tellez, MS; Jonas Annuscheit, BS;
Peter Hufnagl, PhD; Mira Valkonen, MS; Kimmo Kartasalo, MS; Leena Latonen, PhD; Pekka
Ruusuvuori, PhD; Kaisa Liimatainen, MS; Shadi Albarqouni, PhD; Bharti Mungal, MS;
Ami George, MS; Stefanie Demirci, PhD; Nassir Navab, PhD; Seiryo Watanabe, MS; Shigeto
Seno, PhD; Yoichi Takenaka, PhD; Hideo Matsuda, PhD; Hady Ahmady Phoulady, PhD; Vassili
Kovalev, PhD; Alexander Kalinovsky, MS; Vitali Liauchuk, MS; Gloria Bueno, PhD; M.
Milagro Fernandez-Carrobles, PhD; Ismael Serrano, PhD; Oscar Deniz, PhD; Daniel Racoceanu,
PhD; Rui Venâncio, MS.
Affiliations of The CAMELYON16 Consortium Authors: Department of Pathology, University Medical Center Utrecht, Utrecht, the Netherlands
(Manson, Stathonikos); Department of Pathology, Radboud University Medical Center,
Nijmegen, the Netherlands (Hermsen, Balkenhol, Geessink, Bult, Tellez); Laboratorium
Pathologie Oost Nederland, Hengelo, the Netherlands (Geessink); Rijnstate Hospital,
Arnhem, the Netherlands (van Dijk); BeckLab, Beth Israel Deaconess Medical Center,
Harvard Medical School, Boston, Massachusetts (Beca, Beck, Wang, Irshad); PathAI,
Cambridge, Massachusetts (Beck, Wang, Khosla); Computer Science and Artificial Intelligence
Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts (Khosla);
Harker School, San Jose, California (Gargeya); Center for Clinical Data Science, Gordon
Center for Medical Imaging, Massachusetts General Hospital, Harvard Medical School,
Boston, Massachusetts (Zhong, Dou, Li); Chinese University of Hong Kong, Hong Kong,
China (Dou, Chen, Lin, Heng); ExB Research and Development GmbH, Munich, Germany (Haß,
Bruni); Munich Business School, Munich, Germany (Wong); Department of Electrical and
Electronics Engineering, Middle East Technical University, Ankara, Turkey (Halici,
Öner); Neuroscience and Neurotechnology, Graduate School of Natural and Applied Sciences,
Middle East Technical University, Ankara, Turkey (Halici); Cancer System Biology Laboratory,
Graduate School of Informatics, Middle East Technical University, Ankara, Turkey (Cetin-Atalay);
NLP LOGIX, Jacksonville, Florida (Berseth); Smart Imaging Technologies, Houston, Texas
(Khvatkov, Vylegzhanin); Department of Electrical and Computer Engineering, University
of Toronto, Toronto, Ontario, Canada (Kraus); Tissue Image Analytics Lab, Department
of Computer Science, University of Warwick, Coventry, United Kingdom (Shaban, Rajpoot,
Sirinukunwattana, Qaiser); Department of Pathology, University Hospitals Coventry
and Warwickshire National Health Service Foundation Trust, Coventry, United Kingdom
(Rajpoot, Tsang); Department of Computer Science and Engineering, Qatar University,
Doha, Qatar (Awan); Hochschule für Technik und Wirtschaft, Berlin, Germany (Annuscheit,
Hufnagl, Kartasalo, Ruusuvuori, Liimatainen); BioMediTech Institute and Faculty of
Medicine and Life Sciences, Tampere University of Technology, Tampere, Finland (Valkonen);
BioMediTech Institute and Faculty of Biomedical Science and Engineering, Tampere University
of Technology, Tampere, Finland (Kartasalo); Prostate Cancer Research Center, Faculty
of Medicine and Life Sciences and BioMediTech, University of Tampere, Tampere, Finland
(Latonen); Faculty of Computing and Electrical Engineering, Tampere University of
Technology, Pori, Finland (Ruusuvuori); Technical University of Munich, Munich, Germany
(Albarqouni, Mungal, George, Demirci, Navab); Department of Bioinformatic Engineering,
Osaka University (Watanabe, Seno, Takenaka, Matsuda); University of South Florida,
Tampa, Florida (Ahmady Phoulady); Biomedical Image Analysis Department, United Institute
of Informatics Problems, Belarus National Academy of Sciences, Minsk, Belarus (Kovalev,
Kalinovsky, Liauchuk); Visilab, University of Castilla-La Mancha, Ciudad Real, Spain
(Bueno, Fernandez-Carrobles, Serrano, Deniz); INSERM, Laboratoire d’Imagerie Biomédicale,
Sorbonne Universiteś, Pierre and Marie Curie University, Paris, France (Racoceanu);
Pontifical Catholic University of Peru, San Miguel, Lima, Peru (Racoceanu); Sorbonne
University, Pierre and Marie Curie University, Paris, France (Venâncio).
Author Contributions: Mr Ehteshami Bejnordi had full access to all of the data in the study and takes responsibility
for the integrity of the data and the accuracy of the data analysis.
Concept and design: Ehteshami Bejnordi, Veta, van Diest, van Ginneken, Karssemeijer, Litjens, van der
Laak, Beca, Lin, Takenaka.
Acquisition, analysis, or interpretation of data: Ehteshami Bejnordi, Veta, van Diest, van Ginneken, Litjens, van der Laak, Hermsen,
Manson, Balkenhol, Geessink, Stathonikos, van Dijk, Bult, Beca, Beck, Wang, Khosla,
Gargeya, Irshad, Zhong, Dou, Li, Chen, Lin, Heng, Haß, Bruni, Wong, Halici, Ümit Öner,
Cetin-Atalay, Berseth, Khvatkov, Vylegzhanin, Kraus, Shaban, Rajpoot, Awan, Sirinukunwattana,
Qaiser, Tsang, Tellez, Annuscheit, Hufnagl, Valkonen, Kartasalo, Latonen, Ruusuvuori,
Liimatainen, Albarqouni, Munjal, George, Demirci, Navab, Watanabe, Seno, Matsuda,
Ahmady Phoulady, Kovalev, Kalinovsky, Liauchuk, Bueno, Fernandez-Carrobles, Serrano,
Deniz, Racoceanu, Venâncio.
Drafting of the manuscript: Ehteshami Bejnordi, Veta, Litjens, van der Laak, Beca, Berseth, Sirinukunwattana,
Valkonen, Latonen, Ruusuvuori, Liimatainen, Takenaka.
Critical revision of the manuscript for important intellectual content: Ehteshami Bejnordi, Veta, van Diest, van Ginneken, Karssemeijer, Litjens, van der
Laak, Hermsen, Manson, Balkenhol, Geessink, Stathonikos, van Dijk, Bult, Beca, Beck,
Wang, Khosla, Gargeya, Irshad, Zhong, Dou, Li, Chen, Lin, Heng, Haß, Bruni, Wong,
Halici, Ümit Öner, Cetin-Atalay, Khvatkov, Vylegzhanin, Kraus, Shaban, Rajpoot, Awan,
Qaiser, Tsang, Tellez, Annuscheit, Hufnagl, Kartasalo, Albarqouni, Munjal, George,
Demirci, Navab, Watanabe, Seno, Matsuda, Ahmady Phoulady, Kovalev, Kalinovsky, Liauchuk,
Bueno, Fernandez-Carrobles, Serrano, Deniz, Racoceanu, Venâncio.
Statistical analysis: Ehteshami Bejnordi, Karssemeijer, Litjens, van der Laak, Wang, Khosla, Gargeya, Irshad,
Zhong, Dou, Li, Chen, Lin, Heng, Haß, Bruni, Wong, Halici, Khvatkov, Vylegzhanin,
Kraus, Rajpoot, Awan, Qaiser, Tellez, Annuscheit, Valkonen, Latonen, Ruusuvuori, Liimatainen,
Munjal, George, Watanabe, Seno, Matsuda, Kovalev, Fernandez-Carrobles, Serrano, Racoceanu.
Obtained funding: van Ginneken, Karssemeijer, van der Laak, Stathonikos.
Administrative, technical, or material support: Ehteshami Bejnordi, Veta, van Diest, van Ginneken, Litjens, Hermsen, Manson, Balkenhol,
Geessink, Stathonikos, Lin, Demirci.
Supervision: Veta, van Diest, van Ginneken, Karssemeijer, Litjens, van der Laak, Beca, Latonen,
Ruusuvuori, Navab, Takenaka.
Drs Litjens and van der Laak contributed equally to the supervision of the study.
Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential
Conflicts of Interest. Dr Veta reported receiving grant funding from Netherlands Organization
for Scientific Research. Dr van Ginneken reported being a co-founder of and holding
shares from Thirona and receiving grant funding and royalties from Mevis Medical Solutions.
Dr Karssemeijer reported receiving holding shares in Volpara Solutions, QView Medical,
and ScreenPoint Medical BV; consulting fees from QView Medical; and being an employee
of ScreenPoint Medical BV. Dr van der Laak reported receiving personal fees from Philips,
ContextVision, and Diagnostic Services Manitoba. Dr Manson reported receiving grant
funding from Dutch Cancer Society. Mr Geessink reported receiving grant funding from
Dutch Cancer Society. Dr Beca reported receiving personal fees from PathAI and Nvidia
and owning stock in Nvidia. Dr Li reported receiving grant funding from the National
Institutes of Health. Dr Ruusuvuori reported receiving grant funding from Finnish
Funding Agency for Innovation. No other disclosures were reported.
Funding/Support: Data collection and annotation were funded by Stichting IT Projecten and by the Fonds
Economische Structuurversterking (tEPIS/TRAIT project; LSH-FES Program 2009; DFES1029161
and FES1103JJT8U). Fonds Economische Structuurversterking also supported (in kind)
web-access to whole-slide images. This work was supported by grant 601040 from the
Seventh Framework Programme for Research–funded VPH-PRISM project of the European
Union (Mr Ehteshami Bejnordi).
Role of the Funder/Sponsor: The funders and sponsors had no role in the design and conduct of the study; collection,
management, analysis, and interpretation of the data; preparation, review, or approval
of the manuscript; and decision to submit the manuscript for publication.
The CAMELYON16 Collaborators: Ewout Schaafsma, MD, PhD; Benno Kusters, MD, PhD; Michiel vd Brand, MD; Lucia Rijstenberg,
MD; Michiel Simons, MD; Carla Wauters, MD, PhD; Willem Vreuls, MD; Heidi Kusters,
MD, PhD; Robert Jan van Suylen, MD, PhD; Hans van der Linden, MD, PhD; and Monique
Koopmans, MD, PhD; Gijs van Leeuwen, MD, PhD; and Matthijs van Oosterhout, MD, PhD;
Peter van Zwam, MD.
Additional Contributions: We thank the organizing committee of the 2016 IEEE International Symposium on Biomedical
Imaging for hosting the workshop held as part of the study reported in this article,
the collaborators, and the funding agencies.
Smart Citations