Transformers absolutely do not run in constant time by any reasonable definition... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		christianqchung on Nov 18, 2024 \| parent \| context \| favorite \| on: Extending the context length to 1M tokens Transformers absolutely do not run in constant time by any reasonable definition, no matter what your point is.

anon291 on Nov 18, 2024 [–]

They absolutely do given a sequence size. All models have max context lengths. Thus bounded by a constant

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact