I have been saying this about ai. use if for things you are knowledgeable about to get an idea of how well it does. Worse come to worse play a complex video game and ask it about each section as you get to it. Anyone who does this will get a better idea of llm’s weaknesses.
Yup. A subject you know about is essentially a good ‘control sample’ to be able to gague how good a source actually is
I have been saying this about ai. use if for things you are knowledgeable about to get an idea of how well it does. Worse come to worse play a complex video game and ask it about each section as you get to it. Anyone who does this will get a better idea of llm’s weaknesses.