I don't think the suggested recipients feature pulls from other users' contacts. You, your ex, and the third party have probably been recipients of the same message in the past.