Asuu

Who is responsible when advice that was followed turns out to be wrong?

The maker of the model, the institution that approved it, and the clinician using it may have different responsibilities. Each workflow needs those responsibilities defined, with the law and clinical practice of the place where it is used taken into account.

Open question. Not yet tested.

On this page

Why it is hard.

A model suggests an action, an institution approves its use, and a clinician acts on it. If harm follows, responsibility depends on the facts and the applicable law. A clear record could help examine who did what, but it would not decide a legal case by itself.

The uncertainty does damage before any harm occurs. If the clinician carries everything, the safe course is to ignore the tool, or to follow it every time and say the machine advised it. Both make care worse. Researchers have a name for the second habit: automation bias.

What has been tried.

The legal position varies by jurisdiction and is changing as software and AI are addressed in legislation. The whitepaper proposes a mathematical attribution method for examining a recorded trail. Any legal use would require independent scrutiny and would remain subject to the applicable law.

A direction we would test.

We would settle the question before the first patient, in writing, for each use of each model. The maker answers for the model performing as examined. The hospital answers for approving it for this purpose and for watching it. The clinician answers for the decision, given exactly what was on the screen at the time. The Network's record is what makes that last clause fair.

Learning from an incident and assigning legal responsibility are related but distinct tasks. Reporting and compensation arrangements vary by jurisdiction. Asuu would need to protect useful learning while preserving the rights of a person who was harmed.

How we would know we were wrong.

A written division of responsibility can become a device for pushing risk onto whoever has least power, which is usually the clinician. If the first statements we draft are ones a junior doctor's union would refuse to sign, we have built the wrong thing.

Who could solve it.

A lawyer who works on medical liability. An insurer of hospitals or of doctors. A representative of junior clinicians, who are the people most likely to be left holding the blame. And someone from aviation, or another industry that learned how to report failure without punishing the person who reports it.

Sources and scope

Legal duties depend on the jurisdiction, the product, and the parties involved. This page poses a design question; it is not a conclusion about a particular case.

References may be in English.

Where this connects.

Solve one with us.

Tell us which problem you work on, and what we have got wrong about it.