There are plenty of smooth talkers who can give a good speech, without any umms, and yet leave the audience unfulfilled. Obviously there are just as many bad speeches full of too many umms.

I think there is a middle ground where 'umms' and general fillers make the communication more authentic and seemingly less rehearsed. Most people don't like listening to a robot, not even a well-rehearsed one.