Frustration from Americans attending the 9/11 memorial service a few blocks away is spilling over.