Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To get the production level performance, you do need the RDNA compatible hardware.

However, vLLM supports multi node clusters over normal ethernet too https://docs.vllm.ai/en/stable/serving/parallelism_scaling/#...





Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: