To be fair Madison personally owned around a hundred slaves and the Constitution in Article 1 Section 2 counted slaves as three-fifths of a free individual, but please tell me again that this guy is the patron saint of defining personal freedom and the Constitution some kind of twelve commandments of freedom "Thou shalt count Black people that you hold in bondages as three fifths human". And of course let's ignore the law AS WRITTEN and instead talk about slave owner Madison's feelz on inalienable freedom (◔_◔).
This is so profoundly ignorant that I am surprised it continues to come up.
Under your premise you would have wanted all Slaves to be counted as whole persons. This is exactly what many slave owners wanted, they wanted to have the slaves counted as whole persons so their states would have more power.
The Abolitionists wanted the slaves not to be counted at all
3/5ths was a compromise and directly lead to the eventual abolishment of slavery completely.