• vala@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    26
    ·
    17 hours ago

    the efficiency gains from AI are real

    Citation needed.

    I’m an experienced solo developer who tried embracing the state of the art in agentic programming on a several month long non-trivial project. My income depends on this project succeeding so I’m not fucking around here looking for an excuse for ai to fail. I’m trying to keep up…

    My idea is that if this works, I want it working for me.

    The results were unimpressive at best. It feels very fast at first but the entropy is insidious and comes even faster.

    When you hit the wall where the agent stops being able to understand it’s own work and contextualise tasks in a meaningful way, you’re left with a pile of incomprehensible shit that kind of looks like code.

    You will have nothing. Nothing but a giant token bill, wasted time and a sense of shame.

    • schipelblorp@sh.itjust.works
      link
      fedilink
      arrow-up
      9
      ·
      17 hours ago

      The last study I saw might have been from 18 months ago, but they found that AI costs programmers more time than they saved AND that programmers completely miscalculated the efficiency of AI, unaware that it was slower.

      Whether or not AI is more efficient now, it’s demonstrated that individual programmers are pretty bad at evaluating AI efficiency subjectively.

      That leaves the reports of CEO’s, desperate to justify layoffs from lack of work with AI, desperate to goose their stock prices by being AI-first, and the slavish business press who exclusively repeats whatever they say.

      Citation definitely needed.

      • ebc@lemmy.ca
        cake
        link
        fedilink
        arrow-up
        2
        arrow-down
        1
        ·
        10 hours ago

        18 months is an eternity in terms of AI performance. Local models now are better than the frontiers models were at that moment.

        In my experience, AI automates the boring part of programming (which is actually writing the code). It leaves me able to focus on user experience, architecture, the fun stuff. Am I more productive? Maybe a little, yeah. Is it magically going to replace my whole team? Only a fool would think so.

        • falcunculus@jlai.lu
          link
          fedilink
          arrow-up
          1
          ·
          7 hours ago

          I think every three to six months I read people on HN saying the new X.Y model has finally broken the barrier and is the game changer that will forever transform the industry.

        • schipelblorp@sh.itjust.works
          link
          fedilink
          arrow-up
          2
          ·
          10 hours ago

          Whatever AI is like today, it’s been demonstrated programmers wildly overestimate how much time AI saves them; meanwhile, most everyone else has a vested interest in exagerrating the efficiency of AI and there is very little media presence pushing back against or investigating AI claims.

          “The common wisdom” that AI saves a lot of time could just be to result of ignorance and delusion. I’m happy to wait for objective research before making assumptions one way or the other.

          And however efficient AI actually is, nobody wants to pay the true cost of it yet.