Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
UncleOxidant
on Jan 29, 2025
|
parent
|
context
|
favorite
| on:
Complete hardware and software setup for running D...
Yes, exactly. What I'm saying is that the blog referenced in [0] says you can get good results with 2.51 quantization. The $6000 rig is running Q8. You can probably get similar results with a lesser rig if you use the quantized model.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: