Gell-Mann Amnesia effect - Wiktionary, the free dictionary
en.wiktionary.org
  • bitteroldcoot@piefed.socialEnglish
    9·
    23 days ago

    If you don’t know about this you should. it also applies to ai

    If you know about the subject then you know the newspaper article is crap.
    Then you read the article beside it and believe it.

    The same goes for ai. The answer only appears right, because you didn’t know the right answer.

    • SubArcticTundra@lemmy.mlOPEnglish
      2·
      23 days ago

      Yup. A subject you know about is essentially a good ‘control sample’ to be able to gague how good a source actually is

      • HubertManne@piefed.socialEnglish
        2·
        23 days ago

        I have been saying this about ai. use if for things you are knowledgeable about to get an idea of how well it does. Worse come to worse play a complex video game and ask it about each section as you get to it. Anyone who does this will get a better idea of llm’s weaknesses.