I'm not enough of a fan to know how many of those verses he did sing in concert, but I do know that I have two recordings of him singing the song and they only have one verse in common. Weirdly, this verse ISN'T in the Jeff Buckley version. And it's easily my favorite:
And even though
It all went wrong
I'll stand before the Lord of Song
With nothing on my tongue but Hallelujah