Economists refer to the statistic that accounts for these labor market drop-outs as the labor force participation rate. And as you'll see, it's been on the decline since well before the country's most recent recession, with little sign of improvement: