What does the federal budget debate have to do with life expectancy? Like everything else, our golden years come with a bill. For the government, that takes the form of Social Security. Now, amid talk of cutting such entitlement programs, it seems that rolling back Social Security could affect the rich and poor unequally.

We’re living longer, to the average age of 78, so why not start collecting Social Security benefits just a little bit later? Eric Kingson, who teaches social work at Syracuse University, labels that question a “seductive thought.”

But before we start tinkering with our benefits, he says that we should remember that Congress already raised the eligibility age, for full benefits, by two years, back in the '80s.

“So we’re already cutting benefits for anyone born after 1959,” he says.

Kingson notes that Congress found delaying full benefits until the age of 67 would hurt almost a third of Americans. Now, he says, making the eligibility age even older will hit the poor the hardest. Because, while the wealthy are living longer, the poor are not.

"Those on the lower end, the lower half of the income distribution, their life expectancies have stagnated and some have actually even reversed," says Maya Rockeymoore, president of consulting firm Global Policy Solutions.

She says forcing people to wait even longer for full benefits would mean the poor get a shorter retirement than the rich.

“When you have people who disproportionately die at younger ages their contributions to social security actually go to subsidize the retirement of people who are longer lived and higher income," Rockeymoore says.

And, as for the argument that since we’re living longer we can work longer, according to Eric Kingson, that also depends on your income. The wealthier you are, the better chance you have to choose how long to keep working.