Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
cwyers
12 months ago
|
parent
|
context
|
favorite
| on:
Running GPT-OSS-120B at 500 tokens per second on N...
So, the way speculative decoding works, the model begins predicting at the first wrong token, so you still get 'is' for free.
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: