Compare voluntary survey with mandatory census at own risk: StatsCan

OTTAWA – The first pack of data from 2011’s National Household Survey comes with the census equivalent of a Surgeon General’s warning: make any historical comparisons at your own risk.

Slapped across the back pages of most of the Statistics Canada documents released Wednesday is a disclaimer that the voluntary National Household Survey is an altogether different beast than the now-scrapped mandatory long-form census.

Related

The Harper government touched off a controversy in 2010 when it decided to replace the mandatory long-form census with a voluntary survey. Demographers, analysts and insiders fretted that the quality of the data would suffer.

The agency’s note to readers would appear to validate some of their concerns.

“The NHS estimates are derived from a voluntary survey and are therefore subject to potentially higher non-response error than those derived from the 2006 census long form,” the agency says repeatedly throughout the material released Wednesday.

When it came to comparing the 2006 and 2011 results, the smallest communities had the biggest differences.

The agency says the National Household Survey was most likely to differ from its long-form predecessor in census subdivisions of fewer than 25,000 people. While larger communities were pretty much identical in 2006 and 2011, Statistics Canada says that for smaller areas “there can be large discrepancies between the 2011 census population count and NHS population estimate.”

“Those discrepancies are due to weighting, and as in any survey, they may be larger for small geographic areas,” Statistics Canada says.

The apples-and-oranges nature of the two undertakings is just one of several caveats in the latest tranche of demography data.

Perhaps the biggest is a rather glaring footnote in the handout entitled, “Immigration and Ethnocultural Diversity in Canada.”

While the National Household Survey showed that most people who came to Canada between 2006 and 2011 were born in the Philippines, that finding didn’t jibe at all with the federal government department that tracks immigration.

“This result was not in line with administrative data from the Department of Citizenship and Immigration Canada which provides the number of recent immigrants by their country of birth settling in Canada each year,” the footnote says.

But that wasn’t Statistics Canada’s only headache.

Past efforts to count Canada’s First Nations communities have been hampered by the refusal of some groups to participate, and their latest attempt was no different.

Another note to readers says 36 of the country’s 863 reserves were not counted because census-takers either weren’t allowed in or were interrupted before they could finish their work, or because of natural events such as forest fires.

“Most of the people living on reserves are First Nations registered Indians, and consequently, the impact of the incomplete enumeration will be greatest on data for this population,” the note says.