‘You can’t be at the mercy of those on the extreme left’