Are people losing interest in second homes? It appears so, according to an analysis of the latest Census Bureau data.