If you create a bloc of people providing a service that is illegal, now you've formed a criminal organization, at least in the eyes of law enforcement, and you've painted a target on your back. Can't really unionize effectively unless you're on the right side of the law. Which is another argument for decriminalization.