Just a guess but it sounds like razor bumps/lesions. You may need to see a dermatologist. If you continue to shave a good rule of thumb is to use sharp and clean blades, changing frequiently to prevent rash/bumps/infections. These bumps that you described may and may not go away. Hopefully they will!