A few days ago I wrote about going to the AI Talks meetup and disagreed with the view that humans should always have the last word. I just read “Should algorithms be in the driver's seat?” on Daniel Kahneman’s opinion on the subject, and we share the same views regarding biases affecting humans (in truth, my own view was probably heavily influenced by his book):
“The big advantage that algorithms have over humans is that they don’t have noise,” Kahneman said. “You present them the same problem twice, and you get the same output. That’s just not true of people.”
A human can still provide valuable inputs that a machine can’t — impressions, judgments — but they’re not particularly good at integrating information in a reliable and robust way, Kahneman said. The primary function of a person in a human-machine relationship should be to provide a fail-safe in an emergency situation. […]
“You can combine humans and machines, provided that machines have the last word,” Kahneman said. He added: “In general, if you allow people to override algorithms you lose validity, because they override too often and they override on the basis of their impressions, which are biased and inaccurate and noisy.”
I do think Kahneman here is talking about Narrow AI (*) and not the General AI about which concerns have been raised, but it’s good to read someone actually remind us that, Wait a minute, we’re not perfect, maybe lets turn the priorities around.
The article above includes the full video of a conversation at the 2018 Digital Economy Conference in April this year in NYC, where he made these coments.
(*) Saying Artificial Narrow Intelligence, although correct, just sounds awkward to me.