In order to mine ore, a character must have an item that counts as a mining pick in inventory.

The Mining Pick item is the definitive and original mining pick. Patch 2.0 flagged a number of weapons to also qualify as mining picks, and several other items since them have been added that similarly qualify as mining picks.