Code analysis firm sees no major benefits from AI dev tool when measuring key programming metrics, though others report incremental gains from coding copilots with emphasis on code review.

“Many developers say AI coding assistants make them more productive, but a recent study set forth to measure their output and found no significant gains. Use of GitHub Copilot also introduced 41% more bugs, according to the study from Uplevel”

study referenced: Can GenAI Actually Improve Developer Productivity? (requires email)

  • HubertManne@moist.catsweat.com
    2·
    2 months ago

    I agree there. I like it for doing most of the commenting and by extension causing me to comment more as I change the comments a little. Most of the rest was pretty much available before like suggestions as you type. Im concerned about the energy usage but they can be useful if used properly. I think the real problem is mba’s have bought into that you can hire cheap people and they just have to ask the ai how to do things and it will happen. That they can hire prompting engineers instead of coders.