Trump was said to be left "livid" with the lack of attendees at the event to celebrate the 250th anniversary