This does remind of fractal compression [1] from the 90's which never took off for various reasons which will be relevant here as well.

[1] https://en.wikipedia.org/wiki/Fractal_compression