Finding a nice smaller home on a large lot is very difficult. Having a slightly larger home if you can swing it isn't a bad thing given the length of winter. Factor in the cost of a vacation home plus smaller primary home when comparing to a larger primary home.
