The issue is that it’s a language model. You can go a long way by manipulating language to get useful results but it’s still fundamentally limited by languages inability to perform reason, only to mimic it.

Syntax can only take you so far, and it won’t always take you to the right place. Eventually you need something that can reason about the underlying meaning.