Harry warned of US fury over residency move - 'Some of us