It has to get the image data first, basically just IO time before processing it | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		weird-eye-issue 3 months ago \| parent \| context \| favorite \| on: Can you save on LLM tokens using images instead of... It has to get the image data first, basically just IO time before processing it

ashed96 3 months ago [–]

IIRC there's pre-processing (embedding/tokenization?) before feeding images to LLMs?

Hit this issue optimizing LLM request times. Ending up lowering image resolution. Lost some accuracy but could bear that.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact