In the words of Richard Stallman, it's "pretend intelligence".
The language may be structurally correct and *some* of the facts as well but any real grasp of what is being said is largely missing.
This is a direct result of a design built around probability. The overriding objective is plausibility --- not to be confused with either facts or intelligence.
I agree as a whole but aren't all thoughts some sort of guesswork? Facts just have a higher probability?