Currently it is not possible to know the contacts to which the broadcast failed. It will be helpful for the business(request form many business) to know the details, so that they can correct the issue(Like incorrect phone, etc) and resend the broadcast just for the failed contacts.

Suggestion is to have download option directly in the broadcast panel as in the screenshot with Name, Phone number, Broadcast Status, etc