How to evaluate inexpensive WordPress hosting

There are many factors to consider when looking at an expensive web hosting. Do you have plans for doing your own backups? Are you able to restore from those backups easily? What if the neighboring website on the same server gets hacked? This cost really that big of a deal? Will it cost you more and extras to pay less per month for web hosting?