Details

Autor(en) / Beteiligte

• Finlayson, Samuel G
• Bowers, John D
• Ito, Joichi
• Zittrain, Jonathan L
• Beam, Andrew L
• Kohane, Isaac S

Titel

Adversarial attacks on medical machine learning

Ist Teil von

• Science (American Association for the Advancement of Science), 2019-03, Vol.363 (6433), p.1287-1289

Ort / Verlag

United States: The American Association for the Advancement of Science

Erscheinungsjahr

2019

Link zum Volltext

Quelle

American Association for the Advancement of Science

Beschreibungen/Notizen

• Emerging vulnerabilities demand new conversations With public and academic attention increasingly focused on the new role of machine learning in the health information economy, an unusual and no-longer-esoteric category of vulnerabilities in machine-learning systems could prove important. These vulnerabilities allow a small, carefully designed change in how inputs are presented to a system to completely alter its output, causing it to confidently arrive at manifestly wrong conclusions. These advanced techniques to subvert otherwise-reliable machine-learning systems—so-called adversarial attacks—have, to date, been of interest primarily to computer science researchers ( 1 ). However, the landscape of often-competing interests within health care, and billions of dollars at stake in systems' outputs, implies considerable problems. We outline motivations that various players in the health care system may have to use adversarial attacks and begin a discussion of what to do about them. Far from discouraging continued innovation with medical machine learning, we call for active engagement of medical, technical, legal, and ethical experts in pursuit of efficient, broadly available, and effective health care that machine learning will enable.