The late Stephen Hawking has warned that AI could eventually "spell the end of the human race." Elon Musk has predicted that "robots will be able to do everything better than us." Meanwhile, AI systems are starting to outperform people in domains ranging from board games to speech recognition. Is humanity on the way out?For those not working in AI, it can be difficult to interpret highly visible achievements in the field. Take, for example, Watson's 2011 victory over human Jeopardy champions Brad Rutter and Ken Jennings. This was a stunning achievement: while it should surprise nobody that Watson had access to an encyclopedic amount of knowledge, Jeopardy is a game that requires more than that. The hard part -at least for AI systems, but often also for humansisn't having access to the relevant information, but rather understanding the clue well enough to link it to that. Even many AI researchers, myself included, thought this would remain beyond the capabilities of AI systems for a while to come. We were wrong.But does this mean that Watson had obtained a human-level understanding of the world? No. Watson also produced some cringeworthy responses, for example "What is Toronto?" for a clue in the "US cities" category. This is part of a broader pattern of AI systems achieving superhuman levels of performance, and yet making blunders that leave us scratching our heads. For example, researchers from Carnegie Mellon were able to consistently fool a face recognition system that one of them, clearly a man, was actress Milla Jovovich, by wearing carefully designed eyeglass frames [3].In both cases, what causes the mistake is that the AI system solves the problem in a way that is very different from how humans do it. Often, this involves picking up on some statistical pattern that can be used to surprisingly great effect, but that sometimes produces answers that lack any common sense. Moreover, if something changes about how the data is produced, performance may plummet. This is especially so when the change is intended to mislead the system, as in the case of adding the eyeglass frames.This gives some insight into which jobs, or parts of jobs, the AI systems of today and tomorrow are likely to take over from us. Tasks that require responding to the same kind of standardized input over and over again, with a clear measure