San Francisco is No. 4 on the list, with its cost of living index higher than any of the other 99 places the company looked at. In fact, the city’s cost of living index is a staggering 52 percent higher than the national average, Movato found.

Movato lists the median price for a home in San Francisco at $996,000. The city's ludicrous rental market has been the subject of countless articles, parodies and jokes. In March, a Craigslist ad which listed a mansion in the City’s Forest Hill Extension neighborhood at $45,000 a month set tongues wagging about how San Francisco was no longer an affordable place to live.

Movato found that households in San Francisco spend 34 percent of what they make on rent, which is high, but not as high as New York, where residents spend an average of 38 percent of their annual household income on rent.

The next-higest factor was population density at No. 2 overall, which Movato said was not surprising when you consider all the people (17,233 per square mile) squeezed into the tip of the peninsula.