Yes, that has roughly been my experience. The application throughput offered by IPFS is quite low while the packet throughput is very high. I was experiencing 5-15% packet loss over my internet connection while running IPFS. I'm not sure if a bandwidth limit would even help or if it is related to number of connections.
rate-limiting will only make the matters worse and again turn IPFS nearly useless
they haven't managed to solve these issues for 6 years now