Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> And a final note, predicting one token at a time is what we are doing as humans when we speak...

I wouldn't be surprised if we could predict token groups. When speaking off the cuff, people often rely on well-worn phrases and cliches.



Indeed. An interesting reference to this is the work Millman Parry did to describe the key phrases in the Odyssey and the queues they gave to help someone memorize the poem.

Also, this is maybe a semantic point, but, I am not predicting any words I speak. Not in a statistical sense. I have intent behind my words, which means I have an abstraction of meaning that I want to convey and I assemble the correct words to do that. no part of that is "predictive"


> describe the key phrases in the Odyssey and the queues they gave to help someone memorize the poem.

Queues of words give cues to help memorize.


lol. Hurray for speech to text, I guess.


I think that corresponds to well worn phrases being a “single token”




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: