FedEx does control which locations they stop at and make pickups/dropoffs.
You can pay more to make sure they only stop with you.