Correct. However because ARM has fixed-length instructions the decoder can make more assumptions, keeping the decoder simpler.
Like I said, you its only a small amount of extra silicon you’re paying the x86 tax with, but with the world mostly becoming ARM-compatible, there’s no more reason to pay it.