d

  • mercano@lemmy.world
    link
    fedilink
    arrow-up
    13
    arrow-down
    1
    ·
    10 days ago

    AI doesn’t see a word as a sequence of letters, they just see it as a pointer to an entry in Words table.

      • Lambda@lemmy.ca
        link
        fedilink
        arrow-up
        11
        ·
        10 days ago

        Yeah, if words were actually encoded as 1-hot vectors this would be pretty trivial, but the rest of LLM training would be somewhere between infeasible and impossible. The actual embedding vectors obscure spelling even more.

        Side note: last time I checked, current embedding vectors were approximately 40 dimensional… Has that gone up significantly in the last couple of years?

    • chicken@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      3
      ·
      10 days ago

      Shouldn’t it help that it separated them out with underlines? How does this text break down in terms of tokens?

  • youcantreadthis@quokk.au
    link
    fedilink
    English
    arrow-up
    7
    ·
    10 days ago

    This technology is THEFUTURE if you don’t choke on its dick so hard it looks like you’re trying to fold your own erection between your ass cheeks you’re going to megahell if you don’t understand why we can’t go back to a time without it you’re just an insane Luddite moron