Now that AI has become the main tool used by developers to write code, even in open source environments, it will be how feds will slip in backdoors to applications because nobody is going to review the logic of 20000 lines written by AI in a single commit.
Unless projects completely ban use of AI and only allow small commits, this is going to be inevitable. I’ve been seeing so many applications merging AI slop to their code on github already.
It’s a lot easier for the LLM to lose the plot when they’re writing. So when the sentence is like “I’m hungry, so I’m going to put some waffles in the toaster” and the goal is “expand this out so I can put anything in the toaster. But write it in a way that makes it so I can use any other appliance later.” The output would be like “I’m hungry so I’m going to put some silently approved pancake into the microwave once it’s also an approved appliance.”
So it could be grammatically correct. It might even work, but you accumulate these little kinks in the codebase.
2 prompts in its already lost the plot on a really basic frontend application. I think at best I’ve had it create the first draft of a greenfield project for me cos I dont really like doing that and then I just take it from there
Hah, so in a formatting or logical sense, it works, but it’s obviously not written how humans talk and so appears robotic… Got it, thank you that was easier to understand than I thought lol.
I have unfortunately had to vibe code a few things for work since there’s a lot going on, and I don’t have uninterrupted times to work on stuff, so concentration is almost nonexistent. Using ai to patch or fix or fill has been helpful! But I can see for community projects are problematic!
Yes, the context of what you’re doing certainly matters. I had to get into an archive file that I didn’t know what to do with one time. I used AI to build me a little app to visualize its content. Was it perfect? I doubt it. Did it function and get me the info I was looking for? Yeah!
As a rule of thumb, would you trust Momo Yaoyorozu to build you a solution or do you need to be able to blame someone when the solution blows up regardless of having a human build it?