Hallucinations have characteristics in interpretability studies. That's a foothold into reducing them.

They still won't store much information, but it could mean they're better able to know what they don't know.