Two-month notice period, new offer wants me in three weeks. How does anyone handle this?

Current job wants two months notice per my contract. New offer wants me starting in three weeks and won't budge because their headcount approval expires. I like the new company and don't want to torch the current relationship by ghosting the notice period. How do people actually navigate this without burning a bridge on one side or losing the offer on the other?