A chatbot can produce text, but it can’t sustain a probing conversation about your reasoning. Our work suggests oral assessment has a role in the age of AI.