I read that as it runs in data centers (H100 GPUs) or high-end desktops/laptops ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		organsnyder 6 months ago \| parent \| context \| favorite \| on: Open models by OpenAI I read that as it runs in data centers (H100 GPUs) or high-end desktops/laptops (Strix Halo?).

xyc 6 months ago [–]

I'm running it with ROG Flow Z13 128GB Strix Halo and getting 50 tok/s for 20B model and 12 tok/s for 120B model. I'd say it's pretty usable.

organsnyder 6 months ago | [–]

Excellent! I have a Framework Desktop with 128GB on preorder—really looking forward to getting it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact