They got to him

  • greybeard@feddit.online
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    4
    ·
    4 days ago

    Books contain knowledge, I doubt you will find many English scholars that disagree with that. In the same way, LLMs contain knowledge as well, they just also have the ability to output that knowledge in a more dynamic way than a book. You can argue some words that are more anthropomorphic, but knowledge has been attributed to inanimate objects for millennia.

    • Aeder@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 days ago

      No, LLMs only contain a bunch of numbers that predict which word is likely to follow the previous ones. Their output resembles knowledge simply because the most likely combination of words is one meant to convey information.

      • greybeard@feddit.online
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        3 days ago

        And books just contain a series of words. You are playing semantics games. An ebook is just a bunch of electrons shoved into a rock. Yet, somehow, it also contains knowledge.

        In a less abstract way, LLMs giant relational databases that are expressed by using the relationship between previous words to select a word that might follow. It’s in the relational graph that the knowledge is stored. The information is there, and the way we’ve figured out best to get it out is by generating tokens.