You can actually damage the compound permanently by running them in temps that are too low.

For summer tires, it is not advised to use them below 50 degrees. Some of the more temperamental (sticky) tires will be damaged permanently (I would say in the freezing/near freezing area). They will never perform the same after this happens.