Expert vs. Layperson: Same AI model, vastly different capabilities elicited

The author reflects on how Terry Tao's conversation with ChatGPT about the Jacobian counterexample shows the power of domain expertise in eliciting AI capabilities. The author bets that even with a much smarter model, a layperson couldn't elicit a finding like that. They argue that as AI capabilities increase, the gap between default and maximum performance will persist or grow, especially in scientific research with unbounded ceilings.

• ChatGPT
• LLM
• AI Capabilities
• Fable
• Jacobian conjecture
• Terry Tao
• expertise