Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Aurornis
12 months ago
|
parent
|
context
|
favorite
| on:
Running GPT-OSS-120B at 500 tokens per second on N...
> Yes all this has been known since the M4 came out. The memory bandwidth is too low.
The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth.
zackify
12 months ago
[–]
Which is incredibly slow when you’re over 20k context
Consider applying for YC's Fall 2026 batch!
Applications
are open till July 27.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
The M4 Max with 128GB of RAM (the part used in the comment) has over 500GB/sec of memory bandwidth.