There is XMPP. Messengers of Google and Facebook used it in the early days. From what I know, it failed for multiple reasons.

1. The various clients and servers implemented different subsets of the functionality, which deteriorated UX.

2. Service providers have an incentive to lock you in and the average user doesn't mind. So no one pushed for it.