The last study I saw might have been from 18 months ago, but they found that AI costs programmers more time than they saved AND that programmers completely miscalculated the efficiency of AI, unaware that it was slower.
Whether or not AI is more efficient now, it’s demonstrated that individual programmers are pretty bad at evaluating AI efficiency subjectively.
That leaves the reports of CEO’s, desperate to justify layoffs from lack of work with AI, desperate to goose their stock prices by being AI-first, and the slavish business press who exclusively repeats whatever they say.
18 months is an eternity in terms of AI performance. Local models now are better than the frontiers models were at that moment.
In my experience, AI automates the boring part of programming (which is actually writing the code). It leaves me able to focus on user experience, architecture, the fun stuff. Am I more productive? Maybe a little, yeah. Is it magically going to replace my whole team? Only a fool would think so.
I think every three to six months I read people on HN saying the new X.Y model has finally broken the barrier and is the game changer that will forever transform the industry.
Whatever AI is like today, it’s been demonstrated programmers wildly overestimate how much time AI saves them; meanwhile, most everyone else has a vested interest in exagerrating the efficiency of AI and there is very little media presence pushing back against or investigating AI claims.
“The common wisdom” that AI saves a lot of time could just be to result of ignorance and delusion. I’m happy to wait for objective research before making assumptions one way or the other.
And however efficient AI actually is, nobody wants to pay the true cost of it yet.
The last study I saw might have been from 18 months ago, but they found that AI costs programmers more time than they saved AND that programmers completely miscalculated the efficiency of AI, unaware that it was slower.
Whether or not AI is more efficient now, it’s demonstrated that individual programmers are pretty bad at evaluating AI efficiency subjectively.
That leaves the reports of CEO’s, desperate to justify layoffs from lack of work with AI, desperate to goose their stock prices by being AI-first, and the slavish business press who exclusively repeats whatever they say.
Citation definitely needed.
18 months is an eternity in terms of AI performance. Local models now are better than the frontiers models were at that moment.
In my experience, AI automates the boring part of programming (which is actually writing the code). It leaves me able to focus on user experience, architecture, the fun stuff. Am I more productive? Maybe a little, yeah. Is it magically going to replace my whole team? Only a fool would think so.
I think every three to six months I read people on HN saying the new X.Y model has finally broken the barrier and is the game changer that will forever transform the industry.
Whatever AI is like today, it’s been demonstrated programmers wildly overestimate how much time AI saves them; meanwhile, most everyone else has a vested interest in exagerrating the efficiency of AI and there is very little media presence pushing back against or investigating AI claims.
“The common wisdom” that AI saves a lot of time could just be to result of ignorance and delusion. I’m happy to wait for objective research before making assumptions one way or the other.
And however efficient AI actually is, nobody wants to pay the true cost of it yet.