Maps grounding is an amazing interface for Google Maps - „I’m at x, need to be at y by 5pm. Find me a route that’s walkable and has a good vegan restaurant and a toy store“
I’ve been toying with using an llm to compile to smtlib and solving with z3. It works quite well, although I’m not quite sure how practical (large programs, reliably good runtime) I can make it.
I thought the same then. But the funny thing is that today, it has become a lot easier to recognize the frontier models as not human. All the load bearing and not x but y, etc… weird
The ultimate tell is still the sycophancy. You agree with the suggestion output by the LLM but if it detects even a slight pushback it will completely reverse the previous suggestion. Only way to make it more obvious would be to have the LLM grovel and beg.
If these things have consciousness then we are committing sadism on a massive scale.
It feels like it's getting better at that too. It will push back against obvious nonsense a lot stronger. But you are right that it holds opinions quite a bit less strenuously than humans.
GLM 5.2 is slower for sure (although they offer a fast version), and it's more expensive. But in my experience, it's universally better than Deepseek V4-flash-0731. Don't get me wrong, the new Flash version is amazing.
But the use cases I have looked at are about source code understanding, bug finding, etc. - GLM 5.2 is clearly better.
I think by using some prompt engineering, you will probably be able to close this gap, but some extra work is needed.
And I'll say it again: the new Flash version is amazing. I love it. That level of intelligence for the price is unprecedented, and the fact that it's open weights and runs locally makes me genuinely happy.
it's sort of good at thinking, writing specs, etc.. Also debugging. But as a coder: I see no advantage to opus 4.6 and I preferred sonnet most times already over opus 4.6.
reply