Two shards are required for the +2, and three shards for the +3.
Shards are only dropped from a monster of the corresponding main or sub job at a low rate before the Envincing Idol has been defeated, and is affected by Treasure Hunter.