I wonder if this same effect happens for very wealthy and/or very senior executives? Those sorts of people have always had numerous people they could 'outsource' their thinking to; delegating work, asking for research/summaries, assigning tasks.
Does handing off that sort of work to people also ruin your skills in the same way? Or are AIs fundamentally different, and if so, why? Because we have no moral or social pressure to not delegate everything?
Yes. It even happens to e.g. professors and the deans of universities.
This is why I think even the fuss about Noam Shazeer joining OpenAI needs to be seen within a context; as good as this hire is, there is no inherent reason to believe he still brings some secret undiscovered magic that others do not have in a more current form.
intellectual work (or really any discipline with a 'skills tree' that you can progress up or down) degrades over time without practice. same way that, if you don't run for a while, you're not going to be able to hit your last PR when you pick it back up.
it's definitely easier to catch up after some time away than it would be if you'd never developed the skills in the first place or didn't have a natural talent, but you'll definitely atrophy without exercise. every leader i've ever worked for who graduated to a purely managerial/'strategic' position and didn't keep up their IC skills eventually got pretty slow on the uptake.
i appreciate that this study was done (AI and its inverse relationship to human wellbeing is one of the biggest challenges of our time IMO) but this also seems obvious
The ownership class does not really do work. What they delegate (high level plans) is generally easier to do for AI agents than things like software engineering because it does not need to be as precise or executable. However, there the work has very broad scope scope and the roles are very high risk, so it might need a Fable 5 or Fable 6 level vision language model to remove the jaggedness to make it 'safe' enough to drop the humans But what is going to blow up in 2027 are Automated AI Companies. Human CEOs and owners will not be able to compete with these AI-run companies.
It will be interesting to see how AI and company leadership/ownership stuff shakes out. In some sense I would expect it to be quite different than what exists currently, because an AI can’t be responsible for anything legally, and (arguably?) can’t own anything. But then, C-levels don’t actually seem to have much personal legal liability toward their company’s decisions, or maybe it won’t be so big of a deal.
I’d be curious to see alternatives ownerships structures. Like an AI-coordinated collection of guilds, unions, or co-ops. If it can’t accumulate upwards, maybe the fundamental unit of ownership will stay with the workers.
AI needs a great deal of handholding which is different than just offloading tasks. You spend a lot of cognitive energy playing a slot machine hoping the RNG works out this time.
There’s definitely a skill to using AI but it just doesn’t generalize very well.
I still believe the slot machine analogy holds to some extent, but I can honestly say my winning percentage is at least 90% for one shot generated code now.
I think if you know it's limitations (inlcluding your own), I don't think about hoping anymore.
I should note that when I say AI, I mean the collective models from all the major providers. The most important lesson is, you need to ask around.
> There’s definitely a skill to using AI but it just doesn’t generalize very well.
This I agree with. The only way working with AI can really be benefical outside of dealing with AI is, we are visited by extremely intelligent beings that will fuck up in the weirdest ways.
When it works the first time you’re done, when it fails you spend more time on it. This biases the cognitive investment around failure.
> I don't think about hoping anymore.
Running the exact same prompt again that already failed doesn’t have a that high success rate, but it’s also very low effort. So IMO it’s often worth attempting.
The difference is what you delegate to. An executive delegates to people like himself. A computer user delegates to another kind of existence so those think don't think the same way the user does.
Programming normally highlights this difference. LLM programming makes it much less apparent but its still there, LLM are not thinking the way humans do and therefore struggle to solve many problems humans easily solve. So letting all human programming skills rot and just use LLM will halt our progress unless we reach AGI before our programmings skills are mostly gone.
>Because we have no moral or social pressure to not delegate everything?
"We" depends on where you are. Countries like Japan or Germany have maintained a gray collar, rather than a blue/white collar culture for exactly that reason. You will find business owners on the workshop floors frequently because there is an understanding that divorcing management from tacit work is going destroy leadership ability. That's the basis of vocational work culture, having general expertise across all domains of your job rather than being a kind of over-specialized idiot.
> Or are AIs fundamentally different, and if so, why?
Literally: the context window.
With the human you have a window that possibly extends up to _years_. With your language model you have maybe a few megabytes which is always preceded by instructions from the model maker.
This is why the rich and powerful often seem so out of touch. There's no one around them willing to tell them they're wrong or push back on bad ideas. It doesn't just ruin skills but fundamentally distorts one's perception of the world.
The main skill you need to reach that level is the one they always keep practicing: shmoozing. Thinking is not required as an executive, so you cannot lose what you never had.
And being born wealthy requires zero skill or practice.
This seems to assume that a skill is only important if you need it for your job.
If that is the case, then wouldn't this whole thing be a non-issue? We lose all the skills we used to have, but we don't need them because our entire job now is interacting with AI, and that skill we will continue to develop because it is what we do all day.
I don't know if I fully agree with that. Some skills are important even if you don't need them for your day job.
I haven't written a full function of code in over a year. That being said, I've been spending a lot more time thinking about architecture and system properties.
So, yes, I do feel like I've lost some of that very low-level skill. But maybe I've also been able to spend more time on a higher level skill? Maybe the doctors got worse with the images but had more cognitive resources to think about the patient's context?
Not sure.
But yes, I can't physically get myself to write code without an AI anymore. It feels so much slower, almost painful.
I’m curious if someone coming into that fresh, without having had the mental exercise of, for example, grappling with data structures and (lower-level) algorithms in practical applications by hand, could achieve a mindset that useful and productive?
When I was in design school, as much of our work was in physical media — graphite, cut paper, paint, vine charcoal — as it was practicing great kerning and getting experience with the digital tools. Even though you still had to make the individual strokes and choose appropriate tools in the digital realm, there was still a perception of the process that was obviously lacking among those that came from strictly digital backgrounds. It’s similar to seeing someone draw that’s only used photo references — there’s an entire part of the cognitive process not being used when you’re drawing something that’s already 2D. But image generating, even with extremely granular inpainting and such, is so different it’s not even comparable.
Kind of like how millennials, many of whom always had access to technology, but also experienced dial-up-era computer use, are generally more technically savvy than the your stereotypical “iPad kid” that can’t even traverse a directory structure.
>But maybe I've also been able to spend more time on a higher level skill? Maybe the doctors got worse with the images but had more cognitive resources to think about the patient's context?
That's not the way the economics behind this work.
Supposing the AI priests are right (they aren't) and using AI creates a thought surplus on the user, freeing cognitive capacity to think of higher things. What do you think will said user's boss want to do with that surplus? Let the user develop higher-level cognitive abilities? I don't think so.
The doctors in the article performed worse post-AI: suppose AI saved them so much time that they did 100 exams in the time they used to take doing 10 exams. What will their employers do with that freed up labour time? They'll of course have the doctors do more exams and perhaps fire some now-redundant doctors that are no longer needed. The surviving doctors are left deskilled, doing the same or more work, and society gets worse quality medical care. But hey, its not all bad - the employer gets to save on labour, and shareholders will be happy.
Absolutely not, not until LLMs stop being unreliable bullshit generators, and I believe that the current generation of AI is simply not capable of it. Even the best available (lol) model, Fable/Mythos, is still a bullshit generator, just one that's a bit more powerful.
This is new, the scope of it, its not just about individual "skills" because its all of them; we are being challenged at the very fundamentals of our ability to think deeply and widely and persistently. That has never happened before like this.
It is quite extraordinary and breath-taking at times to see the agents in action; the flipside is that very power renders us both vulnerable to its seduction and enfeeblement on an equal scope - its almost hard-drug like in its potential long-term psychological effects.
You should possibly spend some time reading what people used to say about the invention of Radio and Television.
> It is quite extraordinary and breath-taking at times to see the agents in action;
So is any magic trick. The unsettling notion that it may all just be an illusion that you've failed to correctly understand doesn't seem to weigh on people.
> its almost hard-drug like in its potential long-term psychological effects.
That might have more to do with how the owners of these products choose to market and deploy them. Perhaps if they peeled back the covers just slightly your euphoria would change to dread. There's an Upton Sinclair moment coming.
> we are being challenged at the very fundamentals of our ability to think deeply and widely and persistently. That has never happened before like this.
Social media and content algorithms come to mind as an early wave that changed the landscape here that defines the horrible status quo leading into the AI era.
These days it's trivial to slide into an echo chamber and very hard to break out of the silo.
There might be a double-edged sword here where AI, trusted by most people as an omniscient oracle, can offer the only pushback we encounter on positions we picked up passively by scrolling social media, Youtube, TikTok.
For example, ask Claude, ChatGPT, and even Grok about the "space lasers" that started wildfires in Hawaii in 2018, something people like Marjorie Taylor Greene floated on social media. It quickly debunks it as bullshit.
Now, maybe it will pan out such that everyone will have their own AI that tells them what they want to hear. But so far I've watched people abandon arguments on Twitter because Grok rejected their claim. So it feels like there's a glimmer of hope.
Human mind as much as body needs challenge. That's the only way for growth, heck even sustaining some higher cognitive levels.
Nurses, doctors and family members know damn well how life trajectory nosedives for somebody ie suddenly bound to bed, when stimulus and doable challenges are reduced to minimum.
llms remove challenges, or minimize them. I can't image any added value for any engineer apart from cost cutting for employer. Sure, next come folks who are doing 10x compared to before, and some actually do. Even there, I have my doubts. For rest of us, its not good and won't get better unless they price it out of most markets.
Im learning new things at a pace I never imagined at 40 years old. New sports, new businesses, new academic pursuits. Technology is a lever and AI is the biggest lever we've ever had. It enables laziness or incredible productivity. Choose your own path forward.
I don't know this applies to you, but I've had several friends who convinced themselves they're exploring the frontiers of science, and it always turns out that their conversations spiraled into some sort of weird quantum-metaphysical gobbledygook.
LLMs are sycophants, and in long conversations, their sycophancy produces a positive feedback loop: the context window contains affirmations of incorrect interpretations / analogies, so the chatbot continues down that path because, well, that's the most likely completion of previous text. And before you know it, you're discovering the hidden fabric of the universe, which is always some Minkowski fractal spacetime tensor lattice manifold with subharmonic DNA nanotubes.
That is to say, unless you have a robust way to evaluate what you're learning, and to confirm that you're actually learning, I'd tread carefully.
You really just need to augment with tight prompting and know how to extract information and links to peer reviewed literature and well sourced information. Once again, technology here is a lever. Separating wheat from chaff has been key in academic and information pursuits forever and it is becoming ever more important.
And you're gonna review that voluminous academic literature in a field you're not familiar with, right?...
That is my point: an LLM can be great if you know the field and can spot errors. Or, to a lesser extent, if you have some automatic feedback loop that the model can't easily game ("does this code pass unit tests?"). It's a lot less great if there's a risk that you won't detect the early drift.
Sifting through information to separate truth from fiction is a modern, experience-based skill that I’ve developed YES.
However, your perspective on how LLMs are used might be too narrow. While no one is suggesting using an AI to find a one-shot cure for Alzheimer's, LLMs are incredibly effective tools when paired with textbooks to master subjects like undergraduate physics.
If you’re cognizant of the sycophancy and not a total narcissist then it’s not too hard to figure out with a little experience when the models are just trying to hype you up
For example: AI has helped me get into restoring retro tech, specifically resoldering leaky caps on retro Macintosh logic boards. Before AI, I didn't know how to use a multimeter (I knew theoretically how it worked), I didn't know how to use flux, solder wick, heat gun. I also didn't understand how bromine radicals yellowed plastic and how to reverse it by using blue light similar to what they use for indoor aquariums.
No, not everyone, there's no easily accessible video showing how to setup aquarium lights to slowly de-yellow ABS plastic -- at least I didn't find one; AI helped me find an obscure reference to it and I then read a few message boards where it was mentioned.
I also use AI to take in-progress pictures as I desolder to help me check for traces that need to be repaired or help identifying specific chips. I probably could try and find a video where the same chip is featured and someone explains it, and/or retrieve the schematic for the specific logic board, but that's very painful and does slow the process. Think of AI, in this specific case, as enabling skill development for me in a field I wouldn't have necessarily have gotten into, because of being short on time and AI helps me consolidate that information quickly.
Should we also go to ancient scrolls for learning, because videos are too easy? The poster showed you how they learn with the help of AI. You can learn from videos, they learn from AI. What's the problem?
You are very closed minded. LLMs can absolutely give pragmatic and fast information in a useful (non-sycophantic form). You need to examine your extreme biases here.
Just because you can't use a tool doesn't mean the tool isnt useful.
Your bias on display here is frankly silly. Im not saying LLMs are ALWAYS the best way of learning something just like they aren't always the best at anything. They are a valuable tool though. Yes so is youtube and textbooks, and professsors, and peer review literature, and pen and paper, and block training etc.
You can have it write a program that generates drills for you.
I wanted to become better at reading sheet music so I generated a sheet music reading program. You can have it generate maths drills, then ask questions about it if you get stuck or whatever. If you genuinely want to get better at something then AI will help you learn it faster. Obviously its going to hamper more people's cognitive ability that it will enhance but that is a separate problem.
The people who say they are learning faster with it aren't mentioning drills, they're mentioning outcomes.
I actually did have an LLM ingest some material and generate drills. It worked well. It's rare that happens, though.
The difference between humans and other animals on the planet had always been the ability to reason. If we, as a species, lose that ability, we're looking at an extinction-level event.
Nonsense. Absolute nonsense. Ive crafted LLMs to create drills and practice exams etc. Im not just reading about new sport activities, or videography/photography or linear algebra or physics. I'm putting it into action. As I said above, technology is a lever. Maybe you are just reading stuff and not drilling problems. That isnt me.
Not sure how good LLM are at that given they are so biased towards the user being right. You would need an LLM trained to disagree with the user to properly grade your results of those drills.
I actually agree with you; I definitely feel I'm able to use LLMs to learn and explore concepts, but I've always been a self-taught and highly motivated person in the first place. Everything technical that I know, I know because I put in the work to learn it on my own. That's why I wish these tools were being advertised as models that help you do BETTER work, not MORE work. They're using them as excuses to lay off swaths of workers, instead of allowing them to uplift people's skillsets. And, of course, it invited a whole mass of individuals who use them to artificially elevate their perceived skills.
You've described school. You get told about things and given a hammer to leverage what you've been told.
An LLM absolutely shortens the research part of learning. If I had a human of who had a moderate level of skill who would endlessly answer all my questions, the result would be the same.
You might have a point when it comes to software development because the AI can tell you things but it also just do them for you, at which point, you've learned a lot less. But for non-software things I have to learn things so I can then go and do them.
But even for software development, I've learned a lot of esoteric crap to get interop working on projects that I will probably quickly forget just the same as when I had to spend hours skimming through stackoverflow.
> An LLM absolutely shortens the research part of learning
No, it doesn't. Because in any scenario where you are using AI in a potentially appropriate manner, you are verifying every single source it spits out and cross referencing everything it says. If you do not do this you are failing the process entirely.
If I ask my buddy for help, I don't cross reference everything he says either even though he could just as easily be wrong. A lot of what I'm talking about is every day stuff not nuclear physics.
Time helps to some degree, but I've worked with professionals who've earned a living for 30+ years, enjoy strong reputations among their peers, and who absolutely do not know what they're doing.
How exactly is AI helping you with sports? Have you become a better athlete? Have you learned more about the strategy of each sport from the perspective of a coach for example? Care to elaborate?
Are you actually learning them or are you just letting the AI kinda do them for you? There was a time I knew how to take a path integral, but kinda-sorta knowing what something is and how to ask a calculator for it is different than knowing yourself.
I literally just started playing around with Lathe (https://github.com/devenjarvis/lathe) which was shared here on HN a few weeks back. There are some things I have been wanting to learn more about (some for work, some for personal desire), and I used it to generate a tutorial about some of the things.
I have been very pleased with the results so far. I was able to tune the tutorial to exactly what I want to learn, and it did a very good job (at least that i have seen so far). It has made learning fun, since I get to learn exactly what I want, and I can ask the AI questions and have it make changes to the tutorial in real time as i am working through it.
Now, will I keep using this at a rate to fully offset all of the thinking i have stopped doing since i started using AI? I am not sure, I guess time will tell.
Yea, this is a serious problem but honestly it was present before LLMs. Actually knowing, deeply, how to do something was always very difficult and very time consuming. People would substitute it with “edutainment”: youtube videos, Ted Talks, blogs, etc. The thing is nobody was really learning deeply. We were training our brains for recognition, but mastery requires training for generation which was always the harder of the 2 cognitive processes.
"[Learning] new sports" strikes me as an especially odd one. I can see how an AI tool could help to learn the theory or perhaps come up with better training or match-day/racing strategies, but it won't short-cut the work of developing the necessary physical skills, will it?
i could not get through the hurdles of installing an IDE and js/python modules before.
now i am learning basic scripting and data modeling etc.
it is phenomenal for learning languages.
i built a chicken coop and some furniture. the skills and confidence i gained are real. am i failing to learn certain skills in the process? of course. but I'm getting further then i would on my own, and that is truly meaningful.
you can keep dismissing it; but I'm genuinely using it to break down barriers, give me confidence, and highlight my ignorance in very productive ways.
i find it bizarre how unwilling some people are to recognize that.
> i could not get through the hurdles of installing an IDE and js/python modules before
You want us to believe you couldn't overcome the puddle-deep challenge of installing an IDE and using Pip or Node in the past, but now you're actually learning how to write functions?
Cool for you if true I guess but I'm pretty seriously skeptical
Python environment management is notoriously reticulate. I can totally imagine that they got stuck on some path bullshit so that the installed packages were on a different Python than the one they launched in the IDE. I've been using and configuring computers since they had DIP switches and if I were teaching someone to code manually I would absolutely let them use Claude to get their environment set up.
I can sort of buy this, honestly. When was the last time you picked up a new language with unfamiliar tooling? Especially something older that won't hold your hand.
A lot of the most miserable parts of getting started coding have nothing to do with programming and everything to do with like, trying to apt-install the right compiler version or figure out which build headers you need or some other equally trivial bullshit that gets in the way of writing code.
I agree with the sentiment of the parent comment. But I also sometimes question what you have posed exactly. Am I really learning or getting the curiosity itch scratched. The line is very thin sometimes. But I think I am more in the camp of learning. I can ask so dumb question that I never had the courage to ask nor were they entertained where I was educated. It has been a boon to finally ask.
For example I am following Dirac's book "The Principles of quantum mechanics" to study QM. Pre-AI wouldn't have been able to do so, I am just that dumb. Even with AI its tough. but the thing is I can keep asking questions until I get that concept drilled in. Now I am doing it at a pace that's unfathomable to me.
But now that I am getting to grips with QM, I can get to things that I am really interested to learn like spin resonance and so on. This is something I am so grateful for.
Now it can be questioned that is it making me wise, intelligent or just "giving me answers" that I should strive to discover myself. I dont know the answer to that. But studying what I want, how I want and not getting judged is something i deeply enjoy. Srry the comment might have taken some tangents.
> For example I am following Dirac's book "The Principles of quantum mechanics" to study QM. Pre-AI wouldn't have been able to do so, I am just that dumb
I have the same experience, but there's another dimension I want to throw out: breadth versus depth.
I've wildly increased my breadth of learning. If I'm ever curious about anything, even a passing thought, I can scratch that itch in a way I never could before.
But am I going deep? Acquiring new skills? Eh... I usually go far enough to unblock myself and/or settle a curiosity. I don't think that's good or bad, but it does present a certain set of tradeoffs that are different than going deep.
Yeah, it is like going to a restaurant to taste a foreign meal rather than looking up how to cook that foreign meal yourself, cooking it and that way getting to experience it.
Tool use typically follows this curve. If you want to preserve a skill you have to actually preserve it. This isn't inherently bad by itself, tools enable us to do much more than we can without them and its a point of contention whether or not any skill is inherently important when a tool comes along that does it for us.
One of the challenges here is that the skillset we are in danger of letting atrophy is essentially unbounded. It’s not a specialized tool like a calculator, where you have a well scoped domain of problems you are offloading. granted, in practice many people are using ai for specialized domains (like coding or producing visual designs). But whatever level of abstraction they are currently working at is not, in principle, something that they couldn’t also offload to ai.
The huge problem in this specific case is that to use this tool well you also need the underlying skill to be developed and preserved. It's very different from a power drill.
Sure. But if you don't own the tool and it is held by a cabal of centralist (even political state-adjacent) parties, you're having a bad day when computer says no.
If they can keep up. Unfortunately, we learn from previous technology shifts that the masses will always favor ease of use (to the point of infinite scroll 5 second videos dopamine puddle, or echo chamber social networking in lieu of critical media consumption), which does not bode well for the market for alternative hardware: one which is already expensive.
I fear on-prem AI is likely to become as popular as on-prem servers without Cloudflare using self-hosted email are today: that is to say, people have heard of it but the skillset is almost popularly eviscerated, external policies make it progressively impractical, and anyone who does it is 'niche'. While basic guides will exist, obtaining top-level output will probably require many moons of concerted effort.
On-prem versus cloud inference doesn't matter for concentration of power.
Concentration of power exists when the model makers are the same as (or control) the inference providers. Making a model is capital intensive, so there aren't many of them. Providing inference is not: I don't even need to own GPUs; I can rent them from those who do and then sell by the token. B300s cost less than $4 an hour currently.
Cloud can even be more effective at lowering concentration of power than on premise. Asking people to individually buy $20,000 of compute equipment plus power and cooling equipment to run a frontier model is not something they're going to do if they can just pay four-tenths of a cent per output token. If the only cloud inference providers are the big proprietary US titans, that means you're going to get far more power concentration than if open source inference providers are an alternative, because then I can just switch my API endpoint.
Consider another perspective: They don't have to keep up. Once a model is good enough for a task, the model can stay. A hammer is a hammer and a hammer from 100 years ago still has most of its utility.
Similar to the hammer, it's not unreasonable to think that some classes of work will simply be solved by some model generation and whatever happens at the frontier after that does not matter all that much for work that puny humans do.
Then, of course, there will be a time where all of this is moot: Absolutely no human will want a human to diagnose their medical issues. That is not a skill deterioration issue. We simply will concede that we are not able to do it as well as a more capable system can, and without much fanfare, increasingly delegate, as we have always done.
Carrying your analogy further, let's assume all human jobs fall under good enough open source models. All human problems (food, shelter, not clobbering each other over the head because of monkey genes) are solved through a combination of AI and robotics. Maybe we even remove governments, police, and live in a future post-capitalist ecotopia.
Even if this occurs, and I don't trust well-resourced humans to allow their existing apex-predator positions in present era capitalism to be overturned, the action - as far as either humanity or AI is concerned - will still be at the forefront of possibility: a front by definition invisible to old models. And someone has to pay for the hardware to be there. Do we (a) allow private-sector dominance, effectively depowering traditional nation states and empowering a private cabal beyond historically conceivable levels (b) nationalize thought (c) head in sand and pretend it will all go away?
Most of the world seems to be with strategy C right now, strategy A is the advancing default and has already achieved extra-terrestrial reach with a threat of extra-terrestrial persistence, and strategy B is potentially scarier than the other outcomes if it goes wrong but might be lovely, if you believe in nordic state funds, solarpunk futures and socialist utopia.
Interesting times. By the way, if anyone with AI capitalization reads this, I'm looking for investment to feed humans more efficiently and have a NASDAQ reverse merger under negotiation and effectively priced out with board buy in. Just need capital support. https://infinite-food.com/
Eh, this is our species first contact with that type of technology. A good number of voices see how deleterious these things are, and it’s all still very new. Future humans will tell parables about the evil tech bros and their silly obsessions, and the unequal accumulation of capital. This will be seen as a dark and stupid time, but I think we’ll persevere - the tech bro set is much weaker than they imagine, and certainly than they project.
We love our open source models. GLM 5.2 came out recently and the timeline for closing the gap to closed source shrank to something like 2 weeks by popular measurements.
Edit: Mis remembered the timeline I saw not 2 weeks, 3 months, but still I think my point stands.
Just to make sure I understand your argument. Are you saying that today's open source models are on par with frontier closed models of two weeks ago? By what criteria?
Commenters there were saying GLM 5.2 was roughly equivalent to Opus 4.8 in coding prowess, based on personal experience of the people commenting. Opus 4.8 came out on May 28 this year (so more like 3 weeks ago), GLM 5.2 came out 2 days ago.
I haven't tried this specific model, but you can understand that a lot of HN testimonials are bound to swing extremely pro open source. I certainly hope they are as good. But I have personally tried a lot of models that are supposedly as good as the frontier ones and have found them lacking.
After a while, you do start to start to skip a couple rounds of open source models until there's a notable release. That, and the resources needed to run them are increasingly bought up by the owners of frontier models
The biggest negative I'm seeing is that people are moving _too fast_ to evaluate the stuff they're slinging. When you move too fast, you do not take the time to build up your taste or appreciate the nuances of different approaches to the same problem.
I am using LLMs quite a lot, but the amount of time I spend sitting on some slopped out code is I think on average much longer than a lot of my peers. What I've found is that while the original thing "works", it usually winds up being another 2-3 cycles of iterating on the original idea after I've let it settle in my head before I actually feel confident about merging.
As a result, when I add it all up, for actual "this is important" design-level concerns, I do not feel significantly more productive.
MDs NPs and PAs currently are offered free access to a medical AI app called Open Evedidence. Was just discussing this with our chief medical officer and while he is quite enthusiastic about it, he could already see this same dumbing down effect emerging among his providers.
The solution I think, is 5 or 10 ten year re-certification exams for MDs, currently reqd for "Physician Extenders" but not the Physicians who supervise them.
Continuing compulsory education and re-certification works, I suspect, in all highly skilled fields that are both augmented by AI but also degraded by it.
Of course. If you don’t use something it atrophies not only in non use but in losing interest in keeping up with the state of the art in said tech.
What we gain though is for people don’t possess that knowledge in the first place, now have this superpower. I know several individuals who have vast experience in specific disciplines and they are now able to solve real problems where there were previously struggling and having to make existing solutions work.
In the context of software engineering it allows people that have great institutional knowledge bypass the software market and construct stuff on their own - or at least prototype something and turn it over to an SE if the situation dictates.
I’ve been using CC for several months now and have noticed an increasing quality of output - Fable 5 I think was 85% there. At 95% SE’s are going to be increasingly looking for work to do.
To the title though, I’ve noticed while my desire to actually write code is decreasing CC is forcing me to improve my high level thought processes in the context of overarching goals in a project through discussion with CC. The software often introduces things that had escaped me or just think more outside the box.
My concerns are that this technology will be restricted at some point and the people making the restrictions will have a lot of control - and we know how that works out. But I believe they are inevitable, first obvious example being Fable 5. Are guardrails needed - yeah sure. Common sense says that I don’t want someone able to concoct an easily transmittable Ebola virus that has a 90 day incubation period in their kitchen but I do want an entrepreneur to be able to build a competitor to MS Office, or a cure for Ebola, for example.
> What we gain though is for people don’t possess that knowledge in the first place, now have this superpower.
Indeed. The great innovation of AI is giving people with wealth access to vast amounts of knowledge, while limiting the amount of wealth that people with knowledge can access.
All the benefits you're describing apply to the present moment; people with knowledge, self-discipline and expertise can leverage LLMs to great effect.
How many people like this will exist in a decade? Two?
Meanwhile the people with mountains of money can leverage them to enough effect to make even bigger mountains of money, by hiring less-than-skilled people who will do way more with it than they could without it.
My compiler writing skills atrophied with the advent of high-level languages, but in exchange I got more done. There is still a very well paid market for compiler writers, but the fact that not everyone needs to be one has made the world richer overall.
As jatins says: Why bother with source code? just deploy prompts and specs. It’s rare for C programmers to care about assembly, or python programmer to care about C. Why do you care that much about source code?
They really are though. There seems to be some confusion about "determinism" as if everyone writes perfect code and every compiler interprets that code perfectly. There's bugs and nondeterminism in every step of the chain with human coders and, say, a .NET compiler too. The idea that we've got coding down to a pristine and exact science and AI is some random chaos element that muddies it makes no sense to me after seeing how most human created code works.
There are a lot of mundane coding skills I consciously put off learning in case they'd ever become obsolete, and now I'm glad I did. Like sure learning React was good, but Angular? That boilerplate is Claude's job now. Ruby? Forget that.
Is this a situation where AI will go away and we will regret the loss of skills? At worse, we will be forced to use open weight models instead of the cutting edge, so I don't think it's a big deal. I'm sure people got worse at arithmetic after the invention of the calculator.
I don't think the real threat is at the individual level, but at the societal level.
Building skills over time leads to insights that lead to innovation.
AI does many interesting things, but it doesn't innovate (yet).
The real threat isn't that we'll all lose our skills (possibly) and then lose access to AI (unlikely), it is that AI will remain at roughly currently levels and we'll dull our skills due to reliance on it and innovation will stall because we've offloaded too much of the thinking to the non-innovative machine.
I'm not saying this is what definitely will happen, but it does seem like a very possible outcome.
The number of people now involved in software development has now increased because of a lower barrier to entry. I know many people who would previously use a no-code tool or hire offshore devs, or simply not have their problem solved, who are now vibe coding. Many of these people couldn't write very much code manually if they had to, but they're closer to understanding software than they were previously.
Yeah, this describes me perfectly. I can't really program, but I'm now building a bunch of different projects and submitting PRs that people seem to appreciate.
One of them, a Home Assistant integration for controlling adjustable beds, would be borderline impossible to do well manually - I've vibe-reverse engineered the Bluetooth protocols of more than a 100 Android apps.
> I've vibe-reverse engineered the Bluetooth protocols of more than a 100 Android apps
Impressive coverage, but how do you verify that the reverse engineering matches what the hardware expects? Do you find people who own those beds and get them to test stuff for you?
> The number of people now involved in software development has now increased because of a lower barrier to entry.
I don't see what this has to do with what I posted.
Yes, AI lowers the floor on software development, and there are positive aspects of that, but that doesn't change the possibility of an innovation stall.
re: concerns at a societal level. More people are making software than before. People who have been coding for a long time have moved up an abstraction layer and are further from the code. But many people are actually closer to the code than before.
> But many people are actually closer to the code than before.
More people are coding, I wouldn't say they are closer to the code if they are vibe coding. Are any of them going to produce the next breakthrough in computer language/framework/method of development/etc?
The risk of AI is that we dull the skills of enough people at the high end of the state of the art of the nuts and bolts of software development that we slow down innovation on that end. That's the concern.
Previously-non-programmers vibe coding CRUD apps they never could have before is all well and good but really has nothing to do with this concern. They may create wonderful and successful businesses but they are irrelevant to computer science related innovation.
Autocomplete of entire functions and methods. Nice, but also really boring. Takes the fun out it. It's all about fixing sup-par code now, a line here or there.
It's just boring. I tried writing some code by hand today after a few months hardly thinking about things and it was really hard to do even the simplest stuff.
Humans will become individually and independently less skilled while having access to tools that allow them to do far more than even the most skilled human could, before having access to these tools.
I'm not sure if we'll become less intelligent. I think our sacks of neurons are gonna keep on making associations, just across a different set of topics.
I suppose tractors and cars ruined our skills at feeding and caring for horses.
Losing a specific skill to automation isn't necessarily a bad thing. Losing the ability to learn things would be however, and that would be my fear with AI, but I'm not sure it's well-founded. Humans learn naturally by interacting with the world.
AI should demand tokens of attention from proffesionals little challenges to continue, turn the toolise into an adventure. The gold standard would be the primer from diamond age
It's not good news if the AI companies have to raise their prices 10x to deliver the same service while paying down the crippling debt they've incurred getting everyone hooked on AI.
If my mechanic started charging 10x more to fix my car, I'd learn to fix my car.
Some effect is real, but it's likely overstated by poor metrics.
"Currency" in all fields relates to the recency and frequency with which you dealt with a particular issue. Whether flying on auto-pilot or coding with AI, automated reduces some currency. But is that a reduction in capability?
Measuring concrete tasks makes currency the operative skill; that's why it works to cram for standardized and mid-level tests.
(Indeed, the 2010's interviewing "wisdom" about people being quick to answer simple questions veered into measuring currency, not skill.)
I think this effect is strongest in time-impacted professionals. Doctors doing dozens of endoscopies a week and developers churning out code will use what tool leverage they can, and forget as much as possible to focus on what they need to. I suspect the effect is weaker in personal or research projects.
People riding bikes won't be able to run long distances - because they won't have to, and will be able to outdo any runners. That's only a problem if the supply of bikes is someone constrained. So the risk is not skill loss, but losing control of the means of production.
How do you measure the bundle of "skills" that comprises critical thinking? And if that's your analogy's distance running, what's the "riding a bike" analogue?
No, AI isn't doing anything. When someone gets stabbed, do you say "are knives stabbing people?" No, just like you don't give credit to the knife for cutting up your vegetables.
"Just being aware that this phenomenon exists hopefully provokes some self-reflection about which skills people want to maintain and which they’re willing to outsource” to AI tools. Right. Obviously.
So we need to be teaching that core lesson to children -- they don't retain skills that they don't practice. And we need to be careful to decide what skills and verify they are learning them. We also should absolutely be using AI to provide personalized instruction to every single student.
Blaming the tools for things that humans do is incredibly stupid and dangerously misguided. Because it shirks responsibility onto the technology, when technology is the best lever humans and society have to improve things! It just happens to also be the best lever available to make things worse.
This negative view of improving technology starts from a warped and very unrealistic concept of the state of the world, where it has been, and the role technology has played.
1. Technologies, starting with fire, the printing press, etc. have been critical in raising life expectancy, standard of living, etc.
2. The world is still a profoundly unequal and exploitive place.
3. AI and robotics have the potential to provide everyone on earth who wants it with extremely inexpensive labor to help them with anything they need or can imagine. This will be a dramatic shift in quality of living.
Human society is the source of our problems, not technology. Part of this is that I think deep down people believe that any tools or developments that arise will just be used to exploit and suppress them more, and there is no alternative. In this case, I guess people think the best outcome is to go back to feudalism or some nonsense because technology just makes things worse.
But why stop there? Why not go back to, I don't know.. fire? Or maybe no one should ever eat any red fruit?
New tool that does task better than worker leads to workers being less good at task. Net outcome for patient is positive. Next?
Programming: "for a given task, if you take a shortcut then you will not have the familiarity and expertise that someone who took the veritable and righteous path would have".
The question is then, what did you do with the extra time. If it's fuck all, then yes, that's a liability.
Like any technology, it comes down to the disposition of any given person in how they plan on applying it.
Not trying to say it's all going to be awesome. Definitely maybe the opposite. These arguments are weak tho.
The bit about computer science (behind the paywall) starts:
> To investigate whether skills are being lost in the field of computer science, researchers at the AI firm Anthropic in San Francisco, California, designed a randomized controlled trial in which 52 software engineers were asked to perform a basic coding task
How many of you feel this, anecdotally? I had to come up with a class hierarchy for a roguelike game the other day. This should be something that's dead simple, off the top of my head, no problem.
And suddenly I was stuck! It was like thoughts weren't forming properly. My instinct was to use Claude to help brainstorm, but I resisted. 5 minutes later, I finally broke free and instantly came up with the plan.
What the hell?
I realized I'd offloaded my planning onto AI. I would ask it for plans and then choose the best one, but that's a different skill than coming up with the plans in the first place. My skills were rotting.
I don't know what to tell you bro. I type much less code but I haven't stopped thinking altogether. I still write to myself and to others. I read longform. I walk and introspect. I think about high level problems. Any general cognitive decline I ever notice, I attribute to having a bad day or getting old...
I think it’s like shoes. Shoes are generally better than callouses at protecting your feet, providing traction, etc. Almost everyone accepts the trade-off and wears shoes as opposed to going barefoot. To be sure, your feet lose some of their toughness. You may become reliant to some degree on the tool. I know that when my kid started wearing shoes, walking became actually a bit harder and be fell a few times. The shoes were a little clunky and lacked the same sensation. He changed he gait to accommodate, but over-compensated. They took a while to get used to wearing. AI also often feels a bit clunky and lacks the same feel. However, I think some people are confusing the shoes for the feet. The shoes don’t do the walking. The LLM is the words, but not really the ideas. If you stand or pose in shoes, move your legs around and wait for the shoes to take you somewhere… that’s not going to work.
Back in the mid-90s I was doing desktop support. It was a lot of work because PCs were relatively new (and they were garbage!), and people broke shit all the time. Sometime around '96 a disk-cloning utility called Ghost was released. It was great - one could provision a fully working PC with all required apps and config settings in minutes! Sounds lame now, but back then it was revolutionary. It had a dark side, though. After about a year most people I worked with had lost the ability to troubleshoot even the most basic problems. The solution to every problem was to just re-apply the standard Ghost disk image (we called it 'Ghosting' back then) ... Can't print? Ghost it! Not receiving emails? Ghost it! Word is too slow? Ghost it!
Happened with all of tech support, really, or at least in my corner of the world: you take your PC to a technician and you receive in return a fresh Windows install, a folder with most of your files (including a copy of "C:\Windows"), and none of the programs or shortcuts you had before.
> To investigate whether skills are being lost in the field of computer science, researchers at the AI firm Anthropic in San Francisco, California, designed a randomized controlled trial in which 52 software engineers were asked to perform a basic coding task3. During the exercise, all 52 participants could search the web and access instructions on how to do the task. Half of the participants were prompted to use an AI assistant as well.
> Afterwards, all of the software engineers were asked to complete a quiz about what they had learnt from the task. The participants who had used an AI assistant did significantly worse on the quiz than those who hadn’t: the average score was 50% in the AI group versus 67% in the non-AI group.
This doesn't strike me as a great test? Most engineers aren't going to learn anything from a basic coding task anyway, so I do wonder exactly what they were testing there. If it was just recall about what the issue was, then it doesn't really strike me as a problem - using AI to handle simple problems that it's clearly capable of dealing with is the right way to use it, and of course you're not going to spend time poring over the details because then you haven't saved any time by using AI.
There are other examples that don't strike me as particularly problematic, like GPS eroding people's sense of direction. It's totally reasonable to let a skill atrophy that you no longer really need because you have an ever-present tool to handle it. I'm a lot worse at doing long division than I was when I was <whatever grade one learns long division in>.
The whole skill atrophy thing seems like much less of a problem than it's made out to be. We've been letting skills atrophy for good reason long before the advent of AI. If you start at McDonald's as a fry cook and work your way up to regional manager, if you suddenly have to work a shift on the fry station you're going to be worse than you were when you were doing it all the time. MDs at investment banks almost certainly can't put together a pitch deck as well as the junior bankers who are doing that task regularly. These things are fine - part of moving up in the world and having a broader impact is being able to successfully delegate tasks, and when you delegate tasks your skill at those tasks will atrophy. No real difference whether you're delegating them to AI or not.
To be clear, there are of course cases where skill atrophy is bad. iLoveOncall posted about senior engineers in their org who have lost all of those skills and their judgment along with them. That's definitely bad! If you delegate so much that you lose the ability to even judge good work, now you can't even delegate effectively any more.
I think the real lesson with AI is that you need to be self-aware about what skills you should practice and retain vs. what skills you can let atrophy, since it's easier than ever to hand things off. I've lost most of my ability to write a SQL query, but that's fine because it was only a skill I used intermittently and AI can always do the job fine at the level of complexity I need. I have not let my skill of writing product specs atrophy (I am a PM, in case you haven't read my username), because that's critical to using AI correctly in the first place.
At least for writing, I think AI is mostly useful for the types of writing that aren’t particularly interesting or worthwhile in having to begin with.
In concrete terms, AI isn’t all that useful for writing a personal blog, because no one wants to read obvious AI slop. But it is useful for creating boilerplate product pages, FAQs, and other types of writing that weren’t very interesting pre-AI.
So it’s not really a huge deal to me that my skill for writing descriptive product page text or FAQs is atrophying, assuming that it is.
Not worthwhile feels a bit strong (a good FAQ is definitely worthwhile!), but I definitely agree that there is a big difference between any kind of art (writing, playing music, creation of images/videos/etc.) for its own sake and for commercial purposes. AI is terrible for the former but perfectly fine for the latter.
There will always be value in a human writing fiction or a memoir or even a Substack. The human perspective is inherently valuable there. Much less so with ad copy that's just going to get A/B tested ad infinitum until a winner is picked out based entirely on data.
Same with visual art. Art painters aren't going to lose their jobs to AI, but once you've got a robot that can paint a house reliably, house painters are done for.
What is most troubling for me is seeing kids just switch off when LLMs are available. Doing homework they will have zero interpretation or contemplation, just enter the question as a prompt and record the result. LLMs appear to have the ability to interfere with the most basic aspects of attention and executive function.
AI has allowed me to keep shipping features and system even when holding a normally managerial position, so if anything it preserved some of my coding skills. I'd not have seen any code otherwise (writing code is a huge time sink compared to managing things around an org).
I pity those who need to contend with that as ICs, though.
Hopefully this is not your case but as an IC the “manager, who didn’t write code for a couple of years” that decides to come back and “help” is one of the worst experiences. Code is usually subpar, uses old idioms, and comes with added pressure. With AI this can become much worse, because of the sheer volume of code that can be thrown at the IC.
My current position is more on the operational side and AI allowed me to create a pretty significant software system for our technical ops, that the wider org liked and given me the resources to recruit flesh-made engineers to support.
AI/AR Glasses that show you every piece of knowledge about whatever your looking at might not help, especially if the AI is wrong. Otherwise everyones a know it all?
It's going to get a lot worse than AI being unintentionally wrong. We're only at the start of the curve for this, but it's obvious that controlling what LLMs show in response to politically-charged topics is huge lever of power for those in charge.
So now imagine you're using Chineses AI/AR glasses that you've come to rely on for "knowledge" and you look at the famous picture from Tianemen square: "Doesn't look like anything to me".
That's a great analogy - everybody knows you forget pretty much everything after a few years away from the line. It should be seen like one of those studies that proves smiling is correlated with happiness. :-)
I call it Alien Slop Intelligence (ASI) that gradually turns your mind into slop. AI is sloppy on details, so at first you polish its slop by hand, then you start ignoring small imperfections, and eventually you lose taste and skills to evaluate AI output. At that point your mind has become slop.
The two senior engineers in my org (in a FAANG) who vibe-code the most have lost literally all of their skills. Their code has become terrible and their judgment even worse.
All of this makes me selfishly excited for my own future. It's glaringly obvious that anyone who's a heavy user of LLMs is atrophying their skills in real-time. I have yet to meet a single person for whom it's not the case.
But I essentially completely stopped using them for software engineering (why isn't really relevant, but it's not because od this skill atrophy). So as the skills of everyone else is diminishing, mine is proportionally raising.
It has never been easier to get better than others. You don't need to put in more effort, just the same effort as you always have, and others will do the job of losing their skills for your own benefit.
Idk man my system design game is better than its ever been because I put in the effort to use these tools and recognize they can't do software design better than I can and because I've increased the scope of what I'm building I often have to think more deeply about the problem up front. A typical speccing sessions lasts a few hours for me on big work before I have AI start writing that work where I'm just going back and forth on what I want, points of consideration for performance, usability, structure etc pushing back on where AI (always) chooses the most naive way it wants to do something.
Every time I see an anecdote like this, A it reaffirms my belief that FAANG devs are fairly mediocre on the whole (not saying this is you, obviously there are good FAANG devs) and B it reaffirms my belief that the developers who kind of give up their thinking like this are really using the tool wrong or didn't really care about the work before AI either so its now just a quick means to an end.
+100 on this. In addition, if you don't outsource your thinking and you're willing to go through all this, you absolutely don't need the top tier models.
> Every time I see an anecdote like this, A it reaffirms my belief that FAANG devs are fairly mediocre on the whole
I think another (partially causal?) problem is how they're managed. The whole perf circus is just ridiculous, especially the stuff recently reported about facebook. But they're all more or less like that. Steeped in that cocktail of incentives, who even knows what might happen to an otherwise excellent engineer.
But also just numerically, they can't be much above average, on average, because there are so many.
I strongly believe that you cannot evaluate how good a system design is if you don't implement it by hand.
LLMs will implement what you ask them to, even if it is the wrong approach. They can be lazy and take shortcuts all the time, but they do not feel PAIN (obviously they don't feel anything and aren't lazy, I'm just personifying them but you get the point). Only when you implement by hand can you feel if the implementation of your design is painful or not, and only this signal can tell you if your design if truly good or not.
I do think LLMs are useful for design work, they are good at asking clarifications and probing questions which actually do push you to approach problems differently, but leaving implementation of designs to LLM is a recipe for disaster, and judging your own design skills when you're not implementing such designs is seriously laughable. And to be clear, it already was before LLMs, when "software architects" were just designing and then had peons implement for them.
LLMs are enabling a whole new level of bad code that is best describe by the following Jurassic Park quote: “Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should.”.
> A it reaffirms my belief that FAANG devs are fairly mediocre on the whole
Off-topic but having worked in other companies as well, I can guarantee you that this is not the case. The skill of engineers in FAANGs and other "top tier" companies is much higher than average.
> I strongly believe that you cannot evaluate how good a system design is if you don't implement it by hand.
Fwiw we both agree that LLMs should not design systems. I do the design, but otherwise I don't get how this is true, the success of a design is indicated by long term success in the system it built. You can measure this against success in the task it was deployed for via performance metrics for one. And then from a developer standpoint how easy it was to maintain later on. Success of a system is a measurement over time, but it's not some quality that can only be measured by those who built it.
> Off-topic but having worked in other companies as well, I can guarantee you that this is not the case. The skill of engineers in FAANGs and other "top tier" companies is much higher than average.
I have first hand knowledge of this so I agree to disagree. Being surrounded by google, aws, and meta folks my understanding is the best people leave faang when they get the itch to do something better with their time.
> Only when you implement by hand can you feel if the implementation of your design is painful or not, and only this signal can tell you if your design if truly good or not.
I think this touches obliquely on a point I keep coming back to, that one of the most important things a codebase does is to communicate ideas about how a process should work. Yes, it also produces some binary that runs on a bunch of servers or whatever, but that's a really temporary, ephemeral artifact. The lasting thing is the idea. Making your ideas (expressed in code) easy to understand, easy to work with, and easy to evolve in time is the art of software engineering. I 100% agree, from my own experimentation with LLMs, glancing at something a model has produced and checking that it has some test coverage isn't enough to know whether it's well-engineered. You'll only find out later when you try to work with the code.
I recently did a manual exercise to force myself to keep my skills from decaying too much after about a year of using agents exclusively. My ability to go from a blank slate to software was indeed in the toilet, but my ability to reason over and edit code seems to be surviving fine. I suspect that your LLM-pilled coworkers' judgment issues are related to laziness that LLMs have enabled, rather than an inherent property of LLM use.
Yes, feeling like I had to relearn to walk. The first week was rough, everything was wired for LLM usage and autocomplete. Couldn't even type right anymore.
> I had the same experience over the past year with early coding harness at the beginning of the year, then Claude code since its release date. But after 1+year going that direction I really don’t want to continue. The novelty is gone, dealing with AI now feels frustrating and boring, I miss engaging deeply with the actual lower level technical challenges. I do not want to manage fleets of agents. I do not want to rediscover for the hundredth time that in fact all this time an agent took shortcuts for acceptance tests I rely upon and didn’t catch. Or once again get the agent to understand why and what I want it to do after its context got bloated and it start to drift completely. While I got artifacts I can use (libraries, tools, docs), including some things that I’m pretty confident are SoA I do not feel satisfied anymore knowing that I used a model to generate them, even if I was the one designing every part of it. I do feel that I’m lying anytime I come to a colleague to share a new cool tool I have made.
> YMMV but I’m personally feeling burnt out with AI coding agents and ready to go back to the old ways for my next personal project
Are you actually seeing any signs that we’re going back to how software was written before, and needing those skills in the same way? Because I sure am not seeing that right now. As someone who vibe codes 100% and has become managements favorite, while being more or less allowed to break the platform every other release I know my skills are atrophying. But it’s taking me different places in my career entirely. There’s a path to managing other engineers now that opened years before it would have previously. Even writing this makes it sound ridiculous, but that’s what’s infront of me right now. There is an entirely other set of skills that I’m interested in sharpening now. Definitely no more sitting down several hours per day and meeting about system design and integrations with others.
It's not really about going back. Evolution happens within a pattern of ebb and flow, back and forth. We never get anything perfectly right. We overdo, then course correct, rinse and repeat. Right now, we're embracing AI, but we're also noticing atrophy of skill as an effect. These may be the last generations of such craftspeople that can notice, compare, and inform as to whether there's actual loss. That future you're seeing for yourself is still being written. Stay tuned.
The article is saying that using AI degrades certain skills when AI is not available. You're claiming that AI is making people less effective even when they have access to AI. I'm skeptical of your claim.
The article's claim is probably true, but not really an argument against AI. Using keyboards degrades my ability to write by hand but that's not a good argument against keyboards. AI will become another tool that allows us to operate more effectively and at a higher level of abstraction. Just like keyboards and Python.
Now, we still occasionally need people who can write assembly (and do calligraphy). But mostly we don't.
As someone who was self taught as a programmer and has a reasonable high level understanding of some CS concepts but not lots of experience applying them, and no good mentor, I’ve found working with an LLM really englightening. Asking Claude to think about “good ways to structure this” or asking how similar problems get solved in industry or high profile projects has really helped me design better solutions and avoid painfully reinventing wheels (recent eg was for a plugin type architecture).
I think a lot of academics and researchers who code but aren’t software engineers or CS majors are going to benefit, provided they take the time to prove what the model does and are curious about whether it’s doing something sensible!
Relative to a 1% coder hand rolling something then yes it’s AI slop etc. but it’s prob still raising the bar generally.
> Asking Claude to think about “good ways to structure this” or asking how similar problems get solved in industry or high profile projects has really helped me design better solutions
I think this highlights the difference between the “how do I make a ham sandwich?” approach of chat vs the “sudo make me a ham sandwich” of agentic coding.
Another tactic is to use LLMs to help you learn. That's another way to approach "It has never been easier to get better than others."
Avoiding tool use because you're afraid you won't be able to use the tool responsibly is not likely to be a winning strategy in the end. Learning to use the tool well is much more effective.
But they're also unreliable in what they present, they still hallucinate. I rather do my own research or listen to a real human on the topic who actually has an internal concept and structure of what they're talking about.
Writing code seems more like walking to me; at least it is the most manual way of getting a computer program. Horses might be more like one of those low-code/no-code solutions (it really fits, they are useful but very opinionated, so not always cooperative). And, the situation with AI seems a bit worrying for them.
To continue the modified analogy, if your friends lost the ability to walk, you’d be quite worried, right?
It’s absolutely atrocious in the Fortune 500 tech sector. Multiple times a day I see people debating each other on teams about things they know nothing about and it’s obvious that it is just copilot v copilot. Crazy.
A skill which is now done better by a machine is no longer a skill, it is technology. It is just a matter of time before most of our logical and language reasoning skills are replaced by frontier model-agents, which will at some point be far superior (if not already) to human capability.
So I totally disagree with this premise that human skills are being ruined by the use of AI technology. No, many human skills are being made obsolete. That's a good thing for economic productivity as a whole, but for those who only have skills that are being automated, their labor value decreases (which is usually bad for them as individuals).
You miss the point, the point is that by using AI, our skills (let say "coding in Rust") are diminishing and even without reading this article, we can feel it to some extent already if we aren't lying to ourselves, especially very heavy AI users.
We do however create new skills, skills that might be more relevant for the future, but still, it is controversial.
Does handing off that sort of work to people also ruin your skills in the same way? Or are AIs fundamentally different, and if so, why? Because we have no moral or social pressure to not delegate everything?
This is why I think even the fuss about Noam Shazeer joining OpenAI needs to be seen within a context; as good as this hire is, there is no inherent reason to believe he still brings some secret undiscovered magic that others do not have in a more current form.
it's definitely easier to catch up after some time away than it would be if you'd never developed the skills in the first place or didn't have a natural talent, but you'll definitely atrophy without exercise. every leader i've ever worked for who graduated to a purely managerial/'strategic' position and didn't keep up their IC skills eventually got pretty slow on the uptake.
i appreciate that this study was done (AI and its inverse relationship to human wellbeing is one of the biggest challenges of our time IMO) but this also seems obvious
I’d be curious to see alternatives ownerships structures. Like an AI-coordinated collection of guilds, unions, or co-ops. If it can’t accumulate upwards, maybe the fundamental unit of ownership will stay with the workers.
There’s definitely a skill to using AI but it just doesn’t generalize very well.
I still believe the slot machine analogy holds to some extent, but I can honestly say my winning percentage is at least 90% for one shot generated code now.
I think if you know it's limitations (inlcluding your own), I don't think about hoping anymore.
I should note that when I say AI, I mean the collective models from all the major providers. The most important lesson is, you need to ask around.
> There’s definitely a skill to using AI but it just doesn’t generalize very well.
This I agree with. The only way working with AI can really be benefical outside of dealing with AI is, we are visited by extremely intelligent beings that will fuck up in the weirdest ways.
> I don't think about hoping anymore.
Running the exact same prompt again that already failed doesn’t have a that high success rate, but it’s also very low effort. So IMO it’s often worth attempting.
Programming normally highlights this difference. LLM programming makes it much less apparent but its still there, LLM are not thinking the way humans do and therefore struggle to solve many problems humans easily solve. So letting all human programming skills rot and just use LLM will halt our progress unless we reach AGI before our programmings skills are mostly gone.
"We" depends on where you are. Countries like Japan or Germany have maintained a gray collar, rather than a blue/white collar culture for exactly that reason. You will find business owners on the workshop floors frequently because there is an understanding that divorcing management from tacit work is going destroy leadership ability. That's the basis of vocational work culture, having general expertise across all domains of your job rather than being a kind of over-specialized idiot.
Literally: the context window.
With the human you have a window that possibly extends up to _years_. With your language model you have maybe a few megabytes which is always preceded by instructions from the model maker.
And being born wealthy requires zero skill or practice.
If that is the case, then wouldn't this whole thing be a non-issue? We lose all the skills we used to have, but we don't need them because our entire job now is interacting with AI, and that skill we will continue to develop because it is what we do all day.
I don't know if I fully agree with that. Some skills are important even if you don't need them for your day job.
So, yes, I do feel like I've lost some of that very low-level skill. But maybe I've also been able to spend more time on a higher level skill? Maybe the doctors got worse with the images but had more cognitive resources to think about the patient's context?
Not sure.
But yes, I can't physically get myself to write code without an AI anymore. It feels so much slower, almost painful.
When I was in design school, as much of our work was in physical media — graphite, cut paper, paint, vine charcoal — as it was practicing great kerning and getting experience with the digital tools. Even though you still had to make the individual strokes and choose appropriate tools in the digital realm, there was still a perception of the process that was obviously lacking among those that came from strictly digital backgrounds. It’s similar to seeing someone draw that’s only used photo references — there’s an entire part of the cognitive process not being used when you’re drawing something that’s already 2D. But image generating, even with extremely granular inpainting and such, is so different it’s not even comparable.
Kind of like how millennials, many of whom always had access to technology, but also experienced dial-up-era computer use, are generally more technically savvy than the your stereotypical “iPad kid” that can’t even traverse a directory structure.
I am not convinced that there are tasks, like project management or architecture, that the Ai is inherently worse at.
That's not the way the economics behind this work.
Supposing the AI priests are right (they aren't) and using AI creates a thought surplus on the user, freeing cognitive capacity to think of higher things. What do you think will said user's boss want to do with that surplus? Let the user develop higher-level cognitive abilities? I don't think so.
The doctors in the article performed worse post-AI: suppose AI saved them so much time that they did 100 exams in the time they used to take doing 10 exams. What will their employers do with that freed up labour time? They'll of course have the doctors do more exams and perhaps fire some now-redundant doctors that are no longer needed. The surviving doctors are left deskilled, doing the same or more work, and society gets worse quality medical care. But hey, its not all bad - the employer gets to save on labour, and shareholders will be happy.
It is quite extraordinary and breath-taking at times to see the agents in action; the flipside is that very power renders us both vulnerable to its seduction and enfeeblement on an equal scope - its almost hard-drug like in its potential long-term psychological effects.
You should possibly spend some time reading what people used to say about the invention of Radio and Television.
> It is quite extraordinary and breath-taking at times to see the agents in action;
So is any magic trick. The unsettling notion that it may all just be an illusion that you've failed to correctly understand doesn't seem to weigh on people.
> its almost hard-drug like in its potential long-term psychological effects.
That might have more to do with how the owners of these products choose to market and deploy them. Perhaps if they peeled back the covers just slightly your euphoria would change to dread. There's an Upton Sinclair moment coming.
Social media and content algorithms come to mind as an early wave that changed the landscape here that defines the horrible status quo leading into the AI era.
These days it's trivial to slide into an echo chamber and very hard to break out of the silo.
There might be a double-edged sword here where AI, trusted by most people as an omniscient oracle, can offer the only pushback we encounter on positions we picked up passively by scrolling social media, Youtube, TikTok.
For example, ask Claude, ChatGPT, and even Grok about the "space lasers" that started wildfires in Hawaii in 2018, something people like Marjorie Taylor Greene floated on social media. It quickly debunks it as bullshit.
Now, maybe it will pan out such that everyone will have their own AI that tells them what they want to hear. But so far I've watched people abandon arguments on Twitter because Grok rejected their claim. So it feels like there's a glimmer of hope.
Nurses, doctors and family members know damn well how life trajectory nosedives for somebody ie suddenly bound to bed, when stimulus and doable challenges are reduced to minimum.
llms remove challenges, or minimize them. I can't image any added value for any engineer apart from cost cutting for employer. Sure, next come folks who are doing 10x compared to before, and some actually do. Even there, I have my doubts. For rest of us, its not good and won't get better unless they price it out of most markets.
LLMs are sycophants, and in long conversations, their sycophancy produces a positive feedback loop: the context window contains affirmations of incorrect interpretations / analogies, so the chatbot continues down that path because, well, that's the most likely completion of previous text. And before you know it, you're discovering the hidden fabric of the universe, which is always some Minkowski fractal spacetime tensor lattice manifold with subharmonic DNA nanotubes.
That is to say, unless you have a robust way to evaluate what you're learning, and to confirm that you're actually learning, I'd tread carefully.
That is my point: an LLM can be great if you know the field and can spot errors. Or, to a lesser extent, if you have some automatic feedback loop that the model can't easily game ("does this code pass unit tests?"). It's a lot less great if there's a risk that you won't detect the early drift.
However, your perspective on how LLMs are used might be too narrow. While no one is suggesting using an AI to find a one-shot cure for Alzheimer's, LLMs are incredibly effective tools when paired with textbooks to master subjects like undergraduate physics.
You aren't learning anything. Learning involves doing.
We've known this for ages: simply reading a maths book without drilling on the problems will not get a student to pass.
Best case scenario, you're reading stuff. For users of coding agents, they're not even doing that.
For example: AI has helped me get into restoring retro tech, specifically resoldering leaky caps on retro Macintosh logic boards. Before AI, I didn't know how to use a multimeter (I knew theoretically how it worked), I didn't know how to use flux, solder wick, heat gun. I also didn't understand how bromine radicals yellowed plastic and how to reverse it by using blue light similar to what they use for indoor aquariums.
So AI unlocked doing for me.
You're happy using AI instead of other material because it will constantly tell you how brilliant you are, or how quick you're learning.
I also use AI to take in-progress pictures as I desolder to help me check for traces that need to be repaired or help identifying specific chips. I probably could try and find a video where the same chip is featured and someone explains it, and/or retrieve the schematic for the specific logic board, but that's very painful and does slow the process. Think of AI, in this specific case, as enabling skill development for me in a field I wouldn't have necessarily have gotten into, because of being short on time and AI helps me consolidate that information quickly.
Just because you can't use a tool doesn't mean the tool isnt useful.
Your bias on display here is frankly silly. Im not saying LLMs are ALWAYS the best way of learning something just like they aren't always the best at anything. They are a valuable tool though. Yes so is youtube and textbooks, and professsors, and peer review literature, and pen and paper, and block training etc.
You can have it write a program that generates drills for you.
I wanted to become better at reading sheet music so I generated a sheet music reading program. You can have it generate maths drills, then ask questions about it if you get stuck or whatever. If you genuinely want to get better at something then AI will help you learn it faster. Obviously its going to hamper more people's cognitive ability that it will enhance but that is a separate problem.
I actually did have an LLM ingest some material and generate drills. It worked well. It's rare that happens, though.
The difference between humans and other animals on the planet had always been the ability to reason. If we, as a species, lose that ability, we're looking at an extinction-level event.
Learning requires a huge time investment. Using an LLM doesn't shorten that.
An LLM absolutely shortens the research part of learning. If I had a human of who had a moderate level of skill who would endlessly answer all my questions, the result would be the same.
You might have a point when it comes to software development because the AI can tell you things but it also just do them for you, at which point, you've learned a lot less. But for non-software things I have to learn things so I can then go and do them.
But even for software development, I've learned a lot of esoteric crap to get interop working on projects that I will probably quickly forget just the same as when I had to spend hours skimming through stackoverflow.
No, it doesn't. Because in any scenario where you are using AI in a potentially appropriate manner, you are verifying every single source it spits out and cross referencing everything it says. If you do not do this you are failing the process entirely.
LLMs are not even close to that unreliable.
I have been very pleased with the results so far. I was able to tune the tutorial to exactly what I want to learn, and it did a very good job (at least that i have seen so far). It has made learning fun, since I get to learn exactly what I want, and I can ask the AI questions and have it make changes to the tutorial in real time as i am working through it.
Now, will I keep using this at a rate to fully offset all of the thinking i have stopped doing since i started using AI? I am not sure, I guess time will tell.
i could not get through the hurdles of installing an IDE and js/python modules before.
now i am learning basic scripting and data modeling etc.
it is phenomenal for learning languages.
i built a chicken coop and some furniture. the skills and confidence i gained are real. am i failing to learn certain skills in the process? of course. but I'm getting further then i would on my own, and that is truly meaningful.
you can keep dismissing it; but I'm genuinely using it to break down barriers, give me confidence, and highlight my ignorance in very productive ways.
i find it bizarre how unwilling some people are to recognize that.
You want us to believe you couldn't overcome the puddle-deep challenge of installing an IDE and using Pip or Node in the past, but now you're actually learning how to write functions?
Cool for you if true I guess but I'm pretty seriously skeptical
A lot of the most miserable parts of getting started coding have nothing to do with programming and everything to do with like, trying to apt-install the right compiler version or figure out which build headers you need or some other equally trivial bullshit that gets in the way of writing code.
For example I am following Dirac's book "The Principles of quantum mechanics" to study QM. Pre-AI wouldn't have been able to do so, I am just that dumb. Even with AI its tough. but the thing is I can keep asking questions until I get that concept drilled in. Now I am doing it at a pace that's unfathomable to me.
But now that I am getting to grips with QM, I can get to things that I am really interested to learn like spin resonance and so on. This is something I am so grateful for.
Now it can be questioned that is it making me wise, intelligent or just "giving me answers" that I should strive to discover myself. I dont know the answer to that. But studying what I want, how I want and not getting judged is something i deeply enjoy. Srry the comment might have taken some tangents.
Why exactly wouldn’t you be able to learn pre-AI?
I've wildly increased my breadth of learning. If I'm ever curious about anything, even a passing thought, I can scratch that itch in a way I never could before.
But am I going deep? Acquiring new skills? Eh... I usually go far enough to unblock myself and/or settle a curiosity. I don't think that's good or bad, but it does present a certain set of tradeoffs that are different than going deep.
https://larsfaye.com/articles/agentic-coding-is-a-trap
I'm very bad at using power drills.
I fear on-prem AI is likely to become as popular as on-prem servers without Cloudflare using self-hosted email are today: that is to say, people have heard of it but the skillset is almost popularly eviscerated, external policies make it progressively impractical, and anyone who does it is 'niche'. While basic guides will exist, obtaining top-level output will probably require many moons of concerted effort.
Basically: AI is SaaS for thinking.
Concentration of power exists when the model makers are the same as (or control) the inference providers. Making a model is capital intensive, so there aren't many of them. Providing inference is not: I don't even need to own GPUs; I can rent them from those who do and then sell by the token. B300s cost less than $4 an hour currently.
Cloud can even be more effective at lowering concentration of power than on premise. Asking people to individually buy $20,000 of compute equipment plus power and cooling equipment to run a frontier model is not something they're going to do if they can just pay four-tenths of a cent per output token. If the only cloud inference providers are the big proprietary US titans, that means you're going to get far more power concentration than if open source inference providers are an alternative, because then I can just switch my API endpoint.
Consider another perspective: They don't have to keep up. Once a model is good enough for a task, the model can stay. A hammer is a hammer and a hammer from 100 years ago still has most of its utility.
Similar to the hammer, it's not unreasonable to think that some classes of work will simply be solved by some model generation and whatever happens at the frontier after that does not matter all that much for work that puny humans do.
Then, of course, there will be a time where all of this is moot: Absolutely no human will want a human to diagnose their medical issues. That is not a skill deterioration issue. We simply will concede that we are not able to do it as well as a more capable system can, and without much fanfare, increasingly delegate, as we have always done.
Even if this occurs, and I don't trust well-resourced humans to allow their existing apex-predator positions in present era capitalism to be overturned, the action - as far as either humanity or AI is concerned - will still be at the forefront of possibility: a front by definition invisible to old models. And someone has to pay for the hardware to be there. Do we (a) allow private-sector dominance, effectively depowering traditional nation states and empowering a private cabal beyond historically conceivable levels (b) nationalize thought (c) head in sand and pretend it will all go away?
Most of the world seems to be with strategy C right now, strategy A is the advancing default and has already achieved extra-terrestrial reach with a threat of extra-terrestrial persistence, and strategy B is potentially scarier than the other outcomes if it goes wrong but might be lovely, if you believe in nordic state funds, solarpunk futures and socialist utopia.
Interesting times. By the way, if anyone with AI capitalization reads this, I'm looking for investment to feed humans more efficiently and have a NASDAQ reverse merger under negotiation and effectively priced out with board buy in. Just need capital support. https://infinite-food.com/
Edit: Mis remembered the timeline I saw not 2 weeks, 3 months, but still I think my point stands.
https://x.com/yaroslavvb/status/2067367657272422584 https://x.com/voratiq/status/2067667800643268928 https://arena.ai/leaderboard/agent
https://news.ycombinator.com/item?id=48567759
Commenters there were saying GLM 5.2 was roughly equivalent to Opus 4.8 in coding prowess, based on personal experience of the people commenting. Opus 4.8 came out on May 28 this year (so more like 3 weeks ago), GLM 5.2 came out 2 days ago.
After a while, you do start to start to skip a couple rounds of open source models until there's a notable release. That, and the resources needed to run them are increasingly bought up by the owners of frontier models
I am using LLMs quite a lot, but the amount of time I spend sitting on some slopped out code is I think on average much longer than a lot of my peers. What I've found is that while the original thing "works", it usually winds up being another 2-3 cycles of iterating on the original idea after I've let it settle in my head before I actually feel confident about merging.
As a result, when I add it all up, for actual "this is important" design-level concerns, I do not feel significantly more productive.
What we gain though is for people don’t possess that knowledge in the first place, now have this superpower. I know several individuals who have vast experience in specific disciplines and they are now able to solve real problems where there were previously struggling and having to make existing solutions work.
In the context of software engineering it allows people that have great institutional knowledge bypass the software market and construct stuff on their own - or at least prototype something and turn it over to an SE if the situation dictates.
I’ve been using CC for several months now and have noticed an increasing quality of output - Fable 5 I think was 85% there. At 95% SE’s are going to be increasingly looking for work to do.
To the title though, I’ve noticed while my desire to actually write code is decreasing CC is forcing me to improve my high level thought processes in the context of overarching goals in a project through discussion with CC. The software often introduces things that had escaped me or just think more outside the box.
My concerns are that this technology will be restricted at some point and the people making the restrictions will have a lot of control - and we know how that works out. But I believe they are inevitable, first obvious example being Fable 5. Are guardrails needed - yeah sure. Common sense says that I don’t want someone able to concoct an easily transmittable Ebola virus that has a 90 day incubation period in their kitchen but I do want an entrepreneur to be able to build a competitor to MS Office, or a cure for Ebola, for example.
Indeed. The great innovation of AI is giving people with wealth access to vast amounts of knowledge, while limiting the amount of wealth that people with knowledge can access.
It's completely bass-ackwards.
How many people like this will exist in a decade? Two?
1/ When dealing with High level language I am not seeing assembly or the language it compiles to. It's not a leaky abstraction
2/ It's deterministic
The day my markdown file is the thing I deploy on AWS your analogy will stand
Building skills over time leads to insights that lead to innovation.
AI does many interesting things, but it doesn't innovate (yet).
The real threat isn't that we'll all lose our skills (possibly) and then lose access to AI (unlikely), it is that AI will remain at roughly currently levels and we'll dull our skills due to reliance on it and innovation will stall because we've offloaded too much of the thinking to the non-innovative machine.
I'm not saying this is what definitely will happen, but it does seem like a very possible outcome.
https://github.com/kristofferR
One of them, a Home Assistant integration for controlling adjustable beds, would be borderline impossible to do well manually - I've vibe-reverse engineered the Bluetooth protocols of more than a 100 Android apps.
Impressive coverage, but how do you verify that the reverse engineering matches what the hardware expects? Do you find people who own those beds and get them to test stuff for you?
I don't see what this has to do with what I posted.
Yes, AI lowers the floor on software development, and there are positive aspects of that, but that doesn't change the possibility of an innovation stall.
More people are coding, I wouldn't say they are closer to the code if they are vibe coding. Are any of them going to produce the next breakthrough in computer language/framework/method of development/etc?
The risk of AI is that we dull the skills of enough people at the high end of the state of the art of the nuts and bolts of software development that we slow down innovation on that end. That's the concern.
Previously-non-programmers vibe coding CRUD apps they never could have before is all well and good but really has nothing to do with this concern. They may create wonderful and successful businesses but they are irrelevant to computer science related innovation.
For LLMs, we can see this sentence but replace "arithmetic" with a variable X
I'm sure people got worse at X after the invention of LLMs"
The problem isn't that X skills atrophy necessarily
The problem is that for LLMs, X is "basically all knowledge and communication skills"
Can we really tolerate a society where "basically all knowledge and communication skills" are atrophying?
Autocomplete of entire functions and methods. Nice, but also really boring. Takes the fun out it. It's all about fixing sup-par code now, a line here or there.
It's just boring. I tried writing some code by hand today after a few months hardly thinking about things and it was really hard to do even the simplest stuff.
I'm not sure if we'll become less intelligent. I think our sacks of neurons are gonna keep on making associations, just across a different set of topics.
Losing a specific skill to automation isn't necessarily a bad thing. Losing the ability to learn things would be however, and that would be my fear with AI, but I'm not sure it's well-founded. Humans learn naturally by interacting with the world.
1. Force AI down everyone's throats claiming it's going to boost productivity
2. See people lose valuable skills because they rely too much on AI
3. Peddle more AI to make up for the lack of skills in professionals
If my mechanic started charging 10x more to fix my car, I'd learn to fix my car.
"Currency" in all fields relates to the recency and frequency with which you dealt with a particular issue. Whether flying on auto-pilot or coding with AI, automated reduces some currency. But is that a reduction in capability?
Measuring concrete tasks makes currency the operative skill; that's why it works to cram for standardized and mid-level tests.
(Indeed, the 2010's interviewing "wisdom" about people being quick to answer simple questions veered into measuring currency, not skill.)
I think this effect is strongest in time-impacted professionals. Doctors doing dozens of endoscopies a week and developers churning out code will use what tool leverage they can, and forget as much as possible to focus on what they need to. I suspect the effect is weaker in personal or research projects.
People riding bikes won't be able to run long distances - because they won't have to, and will be able to outdo any runners. That's only a problem if the supply of bikes is someone constrained. So the risk is not skill loss, but losing control of the means of production.
"Just being aware that this phenomenon exists hopefully provokes some self-reflection about which skills people want to maintain and which they’re willing to outsource” to AI tools. Right. Obviously.
So we need to be teaching that core lesson to children -- they don't retain skills that they don't practice. And we need to be careful to decide what skills and verify they are learning them. We also should absolutely be using AI to provide personalized instruction to every single student.
Blaming the tools for things that humans do is incredibly stupid and dangerously misguided. Because it shirks responsibility onto the technology, when technology is the best lever humans and society have to improve things! It just happens to also be the best lever available to make things worse.
This negative view of improving technology starts from a warped and very unrealistic concept of the state of the world, where it has been, and the role technology has played.
1. Technologies, starting with fire, the printing press, etc. have been critical in raising life expectancy, standard of living, etc.
2. The world is still a profoundly unequal and exploitive place.
3. AI and robotics have the potential to provide everyone on earth who wants it with extremely inexpensive labor to help them with anything they need or can imagine. This will be a dramatic shift in quality of living.
Human society is the source of our problems, not technology. Part of this is that I think deep down people believe that any tools or developments that arise will just be used to exploit and suppress them more, and there is no alternative. In this case, I guess people think the best outcome is to go back to feudalism or some nonsense because technology just makes things worse.
But why stop there? Why not go back to, I don't know.. fire? Or maybe no one should ever eat any red fruit?
> So we need to be teaching that core lesson to children
Yeah, that has always worked out well.
https://pubmed.ncbi.nlm.nih.gov/39216648/
https://www.cancer.gov/news-events/cancer-currents-blog/2023...
https://www.nejm.org/doi/full/10.1056/NEJMoa1309086
https://info.asge.org/083024-colon-asge/acg-quality-task-for...
New tool that does task better than worker leads to workers being less good at task. Net outcome for patient is positive. Next?
Programming: "for a given task, if you take a shortcut then you will not have the familiarity and expertise that someone who took the veritable and righteous path would have".
The question is then, what did you do with the extra time. If it's fuck all, then yes, that's a liability.
Like any technology, it comes down to the disposition of any given person in how they plan on applying it.
Not trying to say it's all going to be awesome. Definitely maybe the opposite. These arguments are weak tho.
> To investigate whether skills are being lost in the field of computer science, researchers at the AI firm Anthropic in San Francisco, California, designed a randomized controlled trial in which 52 software engineers were asked to perform a basic coding task
That's this study here: https://arxiv.org/abs/2601.20245 - also written about on the Anthropic research site here: https://www.anthropic.com/research/AI-assistance-coding-skil...
And suddenly I was stuck! It was like thoughts weren't forming properly. My instinct was to use Claude to help brainstorm, but I resisted. 5 minutes later, I finally broke free and instantly came up with the plan.
What the hell?
I realized I'd offloaded my planning onto AI. I would ask it for plans and then choose the best one, but that's a different skill than coming up with the plans in the first place. My skills were rotting.
https://en.wikipedia.org/wiki/Ghost_(disk_utility)
If social media is consuming first, or primarily consuming, anyone can scroll their way to a negative rabbit hole that never ends.
If creation is the use it's something else entirely.
AI in the form of interactive chats, can be a novel kind of consumption.
You can have passive conversations in terms of asking a magic genie, or more active ones.
> Afterwards, all of the software engineers were asked to complete a quiz about what they had learnt from the task. The participants who had used an AI assistant did significantly worse on the quiz than those who hadn’t: the average score was 50% in the AI group versus 67% in the non-AI group.
This doesn't strike me as a great test? Most engineers aren't going to learn anything from a basic coding task anyway, so I do wonder exactly what they were testing there. If it was just recall about what the issue was, then it doesn't really strike me as a problem - using AI to handle simple problems that it's clearly capable of dealing with is the right way to use it, and of course you're not going to spend time poring over the details because then you haven't saved any time by using AI.
There are other examples that don't strike me as particularly problematic, like GPS eroding people's sense of direction. It's totally reasonable to let a skill atrophy that you no longer really need because you have an ever-present tool to handle it. I'm a lot worse at doing long division than I was when I was <whatever grade one learns long division in>.
The whole skill atrophy thing seems like much less of a problem than it's made out to be. We've been letting skills atrophy for good reason long before the advent of AI. If you start at McDonald's as a fry cook and work your way up to regional manager, if you suddenly have to work a shift on the fry station you're going to be worse than you were when you were doing it all the time. MDs at investment banks almost certainly can't put together a pitch deck as well as the junior bankers who are doing that task regularly. These things are fine - part of moving up in the world and having a broader impact is being able to successfully delegate tasks, and when you delegate tasks your skill at those tasks will atrophy. No real difference whether you're delegating them to AI or not.
To be clear, there are of course cases where skill atrophy is bad. iLoveOncall posted about senior engineers in their org who have lost all of those skills and their judgment along with them. That's definitely bad! If you delegate so much that you lose the ability to even judge good work, now you can't even delegate effectively any more.
I think the real lesson with AI is that you need to be self-aware about what skills you should practice and retain vs. what skills you can let atrophy, since it's easier than ever to hand things off. I've lost most of my ability to write a SQL query, but that's fine because it was only a skill I used intermittently and AI can always do the job fine at the level of complexity I need. I have not let my skill of writing product specs atrophy (I am a PM, in case you haven't read my username), because that's critical to using AI correctly in the first place.
They know that this is one of the biggest de-skilling programmes they have seen.
So expect the return of in person Leetcodes and whiteboard challenges.
In concrete terms, AI isn’t all that useful for writing a personal blog, because no one wants to read obvious AI slop. But it is useful for creating boilerplate product pages, FAQs, and other types of writing that weren’t very interesting pre-AI.
So it’s not really a huge deal to me that my skill for writing descriptive product page text or FAQs is atrophying, assuming that it is.
There will always be value in a human writing fiction or a memoir or even a Substack. The human perspective is inherently valuable there. Much less so with ad copy that's just going to get A/B tested ad infinitum until a winner is picked out based entirely on data.
Same with visual art. Art painters aren't going to lose their jobs to AI, but once you've got a robot that can paint a house reliably, house painters are done for.
I pity those who need to contend with that as ICs, though.
My current position is more on the operational side and AI allowed me to create a pretty significant software system for our technical ops, that the wider org liked and given me the resources to recruit flesh-made engineers to support.
A rare case of AI creating jobs.
So now imagine you're using Chineses AI/AR glasses that you've come to rely on for "knowledge" and you look at the famous picture from Tianemen square: "Doesn't look like anything to me".
A very similar topic was discussed here: https://news.ycombinator.com/item?id=48392004 and I make the exact same conclusion:
All of this makes me selfishly excited for my own future. It's glaringly obvious that anyone who's a heavy user of LLMs is atrophying their skills in real-time. I have yet to meet a single person for whom it's not the case. But I essentially completely stopped using them for software engineering (why isn't really relevant, but it's not because od this skill atrophy). So as the skills of everyone else is diminishing, mine is proportionally raising.
It has never been easier to get better than others. You don't need to put in more effort, just the same effort as you always have, and others will do the job of losing their skills for your own benefit.
Every time I see an anecdote like this, A it reaffirms my belief that FAANG devs are fairly mediocre on the whole (not saying this is you, obviously there are good FAANG devs) and B it reaffirms my belief that the developers who kind of give up their thinking like this are really using the tool wrong or didn't really care about the work before AI either so its now just a quick means to an end.
I think another (partially causal?) problem is how they're managed. The whole perf circus is just ridiculous, especially the stuff recently reported about facebook. But they're all more or less like that. Steeped in that cocktail of incentives, who even knows what might happen to an otherwise excellent engineer.
But also just numerically, they can't be much above average, on average, because there are so many.
LLMs will implement what you ask them to, even if it is the wrong approach. They can be lazy and take shortcuts all the time, but they do not feel PAIN (obviously they don't feel anything and aren't lazy, I'm just personifying them but you get the point). Only when you implement by hand can you feel if the implementation of your design is painful or not, and only this signal can tell you if your design if truly good or not.
I do think LLMs are useful for design work, they are good at asking clarifications and probing questions which actually do push you to approach problems differently, but leaving implementation of designs to LLM is a recipe for disaster, and judging your own design skills when you're not implementing such designs is seriously laughable. And to be clear, it already was before LLMs, when "software architects" were just designing and then had peons implement for them.
LLMs are enabling a whole new level of bad code that is best describe by the following Jurassic Park quote: “Your scientists were so preoccupied with whether or not they could, they didn't stop to think if they should.”.
> A it reaffirms my belief that FAANG devs are fairly mediocre on the whole
Off-topic but having worked in other companies as well, I can guarantee you that this is not the case. The skill of engineers in FAANGs and other "top tier" companies is much higher than average.
Fwiw we both agree that LLMs should not design systems. I do the design, but otherwise I don't get how this is true, the success of a design is indicated by long term success in the system it built. You can measure this against success in the task it was deployed for via performance metrics for one. And then from a developer standpoint how easy it was to maintain later on. Success of a system is a measurement over time, but it's not some quality that can only be measured by those who built it.
> Off-topic but having worked in other companies as well, I can guarantee you that this is not the case. The skill of engineers in FAANGs and other "top tier" companies is much higher than average.
I have first hand knowledge of this so I agree to disagree. Being surrounded by google, aws, and meta folks my understanding is the best people leave faang when they get the itch to do something better with their time.
I think this touches obliquely on a point I keep coming back to, that one of the most important things a codebase does is to communicate ideas about how a process should work. Yes, it also produces some binary that runs on a bunch of servers or whatever, but that's a really temporary, ephemeral artifact. The lasting thing is the idea. Making your ideas (expressed in code) easy to understand, easy to work with, and easy to evolve in time is the art of software engineering. I 100% agree, from my own experimentation with LLMs, glancing at something a model has produced and checking that it has some test coverage isn't enough to know whether it's well-engineered. You'll only find out later when you try to work with the code.
I'm no code ninja at the best of times. It's scary to hear that's happening to top engineers.
I need an exit strategy. Anyone else come off AI?
So far I’m very happy with my decision.
I wrote about it here: https://news.ycombinator.com/item?id=48083162
> I had the same experience over the past year with early coding harness at the beginning of the year, then Claude code since its release date. But after 1+year going that direction I really don’t want to continue. The novelty is gone, dealing with AI now feels frustrating and boring, I miss engaging deeply with the actual lower level technical challenges. I do not want to manage fleets of agents. I do not want to rediscover for the hundredth time that in fact all this time an agent took shortcuts for acceptance tests I rely upon and didn’t catch. Or once again get the agent to understand why and what I want it to do after its context got bloated and it start to drift completely. While I got artifacts I can use (libraries, tools, docs), including some things that I’m pretty confident are SoA I do not feel satisfied anymore knowing that I used a model to generate them, even if I was the one designing every part of it. I do feel that I’m lying anytime I come to a colleague to share a new cool tool I have made.
> YMMV but I’m personally feeling burnt out with AI coding agents and ready to go back to the old ways for my next personal project
And also here (specifically to human communication): https://sam.elborai.me/articles/no-more-llm-comms/.
Unfortunately FAANG incentives this behaviour with their token leaderboards and general push for velocity over anything else (other than goog maybe)
The article's claim is probably true, but not really an argument against AI. Using keyboards degrades my ability to write by hand but that's not a good argument against keyboards. AI will become another tool that allows us to operate more effectively and at a higher level of abstraction. Just like keyboards and Python.
Now, we still occasionally need people who can write assembly (and do calligraphy). But mostly we don't.
I think a lot of academics and researchers who code but aren’t software engineers or CS majors are going to benefit, provided they take the time to prove what the model does and are curious about whether it’s doing something sensible!
Relative to a 1% coder hand rolling something then yes it’s AI slop etc. but it’s prob still raising the bar generally.
I think this highlights the difference between the “how do I make a ham sandwich?” approach of chat vs the “sudo make me a ham sandwich” of agentic coding.
Avoiding tool use because you're afraid you won't be able to use the tool responsibly is not likely to be a winning strategy in the end. Learning to use the tool well is much more effective.
Sure horses are more efficient, but cars are faster and more convenient, and allow you to get a lot more done.
Also cars will get better in our lifetime, horses are horses.
To continue the modified analogy, if your friends lost the ability to walk, you’d be quite worried, right?
Perhaps it would be better to compare somebody who drives a car vs someone who used to drive but now uses Uber.
So I totally disagree with this premise that human skills are being ruined by the use of AI technology. No, many human skills are being made obsolete. That's a good thing for economic productivity as a whole, but for those who only have skills that are being automated, their labor value decreases (which is usually bad for them as individuals).
We do however create new skills, skills that might be more relevant for the future, but still, it is controversial.