I believe (it has not been proven) that you may harvest from the same crystals if you wait long enough. Such as, if you were to do the sister quest for harvesting flowers, you could easily collect both from one area.