OP clearly states the gun was shipped via FedEx. If the buyer did not confirm with his FFL that they accepted from non-FFL private party then IMO the ball (and the bill) is in his court, as long as you were clear about it up front.

Life - and the good sense to live it!