When something like that happens to me, I pay with a credit card and dispute it afterwards. At the very least, the driver gets hit with a $15 charge for the dispute, regardless of whether he wins. At best, I win the dispute and get my money back.

Edit: also, if there are enough charge-backs/disputes on the driver/company's merchant account, they'll get dropped or have higher rates.