King Charles has reportedly withdrawn an offer for Prince Harry to stay at Buckingham Palace during his London Invictus visit, with a former royal butler saying hopes of reunion are 'very slim.'