Got a second offer three days after accepting the first verbally, and I don't know if it's too late to use it as leverage

Accepted company A on a call Monday, told them yes, still waiting on the written offer. Wednesday company B called with an offer that's meaningfully higher. Nothing's signed with A yet, just a verbal yes. Part of me feels like backing out now would be a bad look and I don't want to burn a bridge over money. The other part knows a verbal yes isn't a contract and companies rescind for less all the time. Has anyone actually gone back on a verbal acceptance for a better offer, and how did that conversation go?