‘If you want to be a New Yorker, make this your primary home, you don’t the pay the tax’