I don't see slavery as an albatross. If anything, America accelerated its demise by its abolition at home --where America wasn't even the biggest enslaver of people; Brazil, The British empire (Caribbean), France (colonies), Russia (serfs), had way, way more slaves than the US. Today, India, China, Horn of Africa, NK have large slave populations.