With the way the new IPB works, following people actually means following them and getting notifications when they post stuff. With all the stuff that was backlogged in the mod que, it was treating every single approved post as a new post, and giving notifications based on those. Once the mod que is completely sorted out, it will no longer be an issue.