Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

So, the way speculative decoding works, the model begins predicting at the first wrong token, so you still get 'is' for free.


Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: