• nohaybanda [he/him]@hexbear.net
    link
    fedilink
    English
    arrow-up
    47
    ·
    10 days ago

    Daily reminder that LLMs do not process words as words but as tokens - basically number IDs. There is absolutely no room there for any kind of understanding to take place. The one thing these things have been optimised to do is output text that is statistically similar to other text