Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

They pick random top-k next token based on their amazing 4chan/reddit training data, duh.


So you you think a model if asked.

"There is an animal very similar to a crocodile but I cannot remember it's name"

and the model responds with

"I believe the animal you are thinking of might be " ("a" / "an")

Are you saying that it would pick the result fairly randomly and then based on it's choice pick an animal that starts with a consonant or a vowel?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: