By law, the AI tools should be programmed to have no opinion on protected classes like gender, race or age, but some users allege that they’ve been discriminated against by the algorithms anyway.

Algorithms should also be explainable, such that communication about what patient information was used in the decision making and explanations on the basis for the decision is clear.