Hopefully both are implemented.
https://github.com/pygfx/wgpu-py/issues/407
PRs welcome though :-)
Fastplotlib / pygfx are primarily meant to run on desktop. When using it via the notebook the server does the rendering.
As Ivo said, we have plans to support running in the browser via Pyodide, which opens some interesting things, but is not the primary purpose.
Hopefully both are implemented.