Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yes, exactly. What I'm saying is that the blog referenced in [0] says you can get good results with 2.51 quantization. The $6000 rig is running Q8. You can probably get similar results with a lesser rig if you use the quantized model.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: