I wonder if this same effect happens for very wealthy and/or very senior executives? Those sorts of people have always had numerous people they could 'outsource' their thinking to; delegating work, asking for research/summaries, assigning tasks.
Does handing off that sort of work to people also ruin your skills in the same way? Or are AIs fundamentally different, and if so, why? Because we have no moral or social pressure to not delegate everything?
Yes. The moment you move from daily IC work to management your skills begin to atrophy. Even if you are magical and somehow they do not - you are not keeping up/practicing on the newer developments.
If you are doing your job as a manager it’s the scariest career possible. There is no realistic fallback to lower paid IC work after a certain amount of years. Your job is to enable others, not do things yourself.
There are shades of grey and you try to keep skills at least honed a little here and there doing R&D and side projects - but it’s just not the same as day to day production line work.
And of course some people start at a much higher baseline of skill than others. The impact is largely the same though over time.
This is by far the single largest caution I give to skilled engineers who talk to me about moving into a management track. It’s a decision not to be taken lightly.
Yes. It even happens to e.g. professors and the deans of universities.
This is why I think even the fuss about Noam Shazeer joining OpenAI needs to be seen within a context; as good as this hire is, there is no inherent reason to believe he still brings some secret undiscovered magic that others do not have in a more current form.
I find this hard to parse, maybe because English is not my first language. Do senior SWEs provide more value than they provide principles, or do they provide more value than principles do?
The ownership class does not really do work. What they delegate (high level plans) is generally easier to do for AI agents than things like software engineering because it does not need to be as precise or executable. However, there the work has very broad scope scope and the roles are very high risk, so it might need a Fable 5 or Fable 6 level vision language model to remove the jaggedness to make it 'safe' enough to drop the humans But what is going to blow up in 2027 are Automated AI Companies. Human CEOs and owners will not be able to compete with these AI-run companies.
It will be interesting to see how AI and company leadership/ownership stuff shakes out. In some sense I would expect it to be quite different than what exists currently, because an AI can’t be responsible for anything legally, and (arguably?) can’t own anything. But then, C-levels don’t actually seem to have much personal legal liability toward their company’s decisions, or maybe it won’t be so big of a deal.
I’d be curious to see alternatives ownerships structures. Like an AI-coordinated collection of guilds, unions, or co-ops. If it can’t accumulate upwards, maybe the fundamental unit of ownership will stay with the workers.
Yeah, the idea that C-suites ever took any significantly liability has always been a fantasy for as long as I can remember. At worst/best case a single lower level individual will be used as a scapegoat for the systemic abuses of the company.
>Because we have no moral or social pressure to not delegate everything?
"We" depends on where you are. Countries like Japan or Germany have maintained a gray collar, rather than a blue/white collar culture for exactly that reason. You will find business owners on the workshop floors frequently because there is an understanding that divorcing management from tacit work is going destroy leadership ability. That's the basis of vocational work culture, having general expertise across all domains of your job rather than being a kind of over-specialized idiot.
intellectual work (or really any discipline with a 'skills tree' that you can progress up or down) degrades over time without practice. same way that, if you don't run for a while, you're not going to be able to hit your last PR when you pick it back up.
it's definitely easier to catch up after some time away than it would be if you'd never developed the skills in the first place or didn't have a natural talent, but you'll definitely atrophy without exercise. every leader i've ever worked for who graduated to a purely managerial/'strategic' position and didn't keep up their IC skills eventually got pretty slow on the uptake.
i appreciate that this study was done (AI and its inverse relationship to human wellbeing is one of the biggest challenges of our time IMO) but this also seems obvious
I've discussed this in my company, where I've argued that we are losing critical thinking skills for AI.
My friend said being an engineer is not just writing code, but designing and architecting the system. I agree, but we are also moving that to AI. We are offloading the thought process to a LLM, which confirms our biases and tells us what we want to hear.
Essentially, we are also losing the software architecture and design skills because we aren't talking to other engineers/architects/designers who may approach the problen in a complete different way; we are just asking the AI to confirm our thoughts.
AI needs a great deal of handholding which is different than just offloading tasks. You spend a lot of cognitive energy playing a slot machine hoping the RNG works out this time.
There’s definitely a skill to using AI but it just doesn’t generalize very well.
I still believe the slot machine analogy holds to some extent, but I can honestly say my winning percentage is at least 90% for one shot generated code now.
I think if you know it's limitations (inlcluding your own), I don't think about hoping anymore.
I should note that when I say AI, I mean the collective models from all the major providers. The most important lesson is, you need to ask around.
> There’s definitely a skill to using AI but it just doesn’t generalize very well.
This I agree with. The only way working with AI can really be benefical outside of dealing with AI is, we are visited by extremely intelligent beings that will fuck up in the weirdest ways.
When it works the first time you’re done, when it fails you spend more time on it. This biases the cognitive investment around failure.
> I don't think about hoping anymore.
Running the exact same prompt again that already failed doesn’t have a that high success rate, but it’s also very low effort. So IMO it’s often worth attempting.
> There isn’t a magic prompt I could have written before knowing the solution. A retrospective prompt can reproduce the 200 lines only because it embeds the invariants you discovered. The useful AI task would have been systematically finding counterexamples and iterating toward those invariants, not generating the final file in one shot.
For me the value with AI isn't the one shot, it is the fact that it can help you iterate faster. My biggest take awway so far with AI is it can help you fail fast. The faster you can fail, the faster you can iterate.
mine def has to be the initial impl of my python to my personal fave compiler ir. i got claude chat to write it in two sentences. 4 turns helping it rmeemver where it put shit becsuse of transcript issues
The code in http://github.com/gitsense/gsc-cli contains over 300 go files and I would say 90% were one shots. I can even prove that they are AI generated since I attribute the AI in each file, as shown in the example below:
Since I don't know go, I can't say which is the best. I am also sure they would not live up to a go experts expectations. I just know that since I don't know go, I would not have been able to create the tool. I can also prove that you can easily maintain AI generated code since I have been expanding and evolving it for over 6 months with pretty much no issues.
This is why the rich and powerful often seem so out of touch. There's no one around them willing to tell them they're wrong or push back on bad ideas. It doesn't just ruin skills but fundamentally distorts one's perception of the world.
Having run into quite a few managers who used to be programmers who can barely do fizzbuzz after a few years of managing: yes, I think it's pretty similar. Much of your brain is "use it or lose it" and that's not using it.
I do think there's more than enough room to claim that LLMs are probably significantly worse than that kind of human delegation though, in part because you have such a rapid cycle time that not-incredibly-rich people can't afford from humans.
> Or are AIs fundamentally different, and if so, why?
Literally: the context window.
With the human you have a window that possibly extends up to _years_. With your language model you have maybe a few megabytes which is always preceded by instructions from the model maker.
That's a misconception. Context window of humans is measured in seconds and limited to single-digit amount of entities. Human attention is truly ephemeral, with a ridiculously short span. What you're talking about cannot be emulated by putting everything into the context, you need models with deeper cognitive capabilities, and the longer your context the smarter it needs to be. It can be done by increasing the depth and the size of the model, and by training it better. Test-time scaling does work (longer reasoning, agentic compression, ICL, etc), but hits the wall rather quickly if not assisted by better cognition.
That's a simple neurologic fact, there's nothing to believe. You can use a trivial experiment to verify that you can't keep details in your sliding attention window for more than a few seconds or focus on more than a few things simultaneously. Human memory and cognition is layered and this immediate layer is what resembles the model's context the most.
You're possibly mixing it up with long-term memory which doesn't keep immediate facts and details, it's for heavily processed and compressed summaries, for the lack of a better analogy from the LLM world. You aren't keeping the entire codebase in your memory, just its highly processed and conceptualized version. This conceptualization can be somewhat emulated as an agentic loop, but it can only go so far, current models quickly lose coherency and aren't good enough to predict what's important.
Models don't need to remember more details, they need stronger processing of what they already remember.
>"Oh yea, just do it _better_. That's your problem."
I think we're talking about different things. Models can be trained better to cram more intelligence into the same amount of parameters, that's what I mean. Similarly to how your ability to learn (and perform) math depends on your prior math training.
> You can use a trivial experiment to verify that you can't keep details in your sliding attention window for more than a few seconds or focus on more than a few things simultaneously.
I said "context window" not "attention window." Of course spans of attention are limited. Knowledge is not. Knowledge is often highly specific.
> You're possibly mixing it up
Not really. You've simply failed to verify your understanding of my argument and instead created something of a strawman.
> You aren't keeping the entire codebase in your memory, just its highly processed and conceptualized version
And what is your basis for this claim? Why a codebase? You don't think I can't remember an entire function? Yet actors can remember entire sets of lines for a scene? Is that just a highly processed and abstracted version in their minds? And they just run some cognitive loop to recreate dialog in real time?
> they need stronger processing of what they already remember.
What is "stronger?" More time? More memory? More compute? And how is that put to use? Why is it, when given certain prompts, that LLMs reproduce 100s of pages of directly copied and copyrighted work?
> Models can be trained better to cram more intelligence into the same amount of parameters, that's what I mean.
Cool. _How_? What is the limit of this training? How efficient is it? How many resources do you need on the input for a given increase in output? Otherwise it's just a ton of hand waving going on here.
If there's an actual neurological attention window that you're referring to, that's as ephemeral as you say, it is not analogous to the context window of an LLM.
When I'm working on a problem, I can explicitly apply knowledge I gained decades ago to that problem. Not just "oh, it's somehow encoded in the training data"; not "oh, it's all mixed in there somewhere"; I can call up the memories, understand how to apply that knowledge to the problem at hand, and do so.
Except in certain very superficial ways, and despite many misguided LLM proponents' strident insistence to the contrary, LLMs do not work much like human brains.
Yes, that's my entire point and I'm well aware about LLM internals. Reread the comment above, I'm responding to a person who suggested to increase the context window of an LLM to make it less different, saying it will never work.
Is this true, though? AIs already interact with way more data than their context window, they can make queries to external data sources, and they can make context references to external data that can be pulled in as needed.
The context window is the working memory, which is not ‘years’ for humans either.
The difference is what you delegate to. An executive delegates to people like himself. A computer user delegates to another kind of existence so those think don't think the same way the user does.
Programming normally highlights this difference. LLM programming makes it much less apparent but its still there, LLM are not thinking the way humans do and therefore struggle to solve many problems humans easily solve. So letting all human programming skills rot and just use LLM will halt our progress unless we reach AGI before our programmings skills are mostly gone.
Yes, but what happens to the professions and classes you've mentioned that wasn't looked at in this study is that new skills developed. For instance, something was assuredly lost as programming on average deviated from low level programming, but new skills and optimizations were gained. Fewer people knew how to construct a real-time bitmap from scratch, but more advanced software was being built on average as people were armed with greater and more manageable abstractions.
The "I have people skills; I am good at dealing with people!" character in Office Space was memorably hilarious for a reason. Many people lose the skills that got them where they are from disuse as they rise through the ranks.
The main skill you need to reach that level is the one they always keep practicing: shmoozing. Thinking is not required as an executive, so you cannot lose what you never had.
And being born wealthy requires zero skill or practice.
This seems to assume that a skill is only important if you need it for your job.
If that is the case, then wouldn't this whole thing be a non-issue? We lose all the skills we used to have, but we don't need them because our entire job now is interacting with AI, and that skill we will continue to develop because it is what we do all day.
I don't know if I fully agree with that. Some skills are important even if you don't need them for your day job.
Does handing off that sort of work to people also ruin your skills in the same way? Or are AIs fundamentally different, and if so, why? Because we have no moral or social pressure to not delegate everything?