Just because it wasn't used as pejorative doesn't mean that the meaning then is something we today should consider it not a problem. What they meant was the same thing we do now. Its just that we now consider it something not all that nice.