Sure you can indeed. For me the compactness of the rpi was a plus however. Since you don't need a dedicated screen or a keyboard (recalbox interface is tailored for controllers), having only to carry the small rpi makes it more convenient and more suited to this use in my view.

Of course, if it's to play at mainly at home then I agree it's not as interesting.