Speaking only for hickory; I've found if the wood isn't properly seasoned having the bark on can make the smoke especially bitter. Heavy bark on seasoned wood doesn't affect taste but can produce flyaway ash that can goop up the bark on your foodstuff. I use a sharp machete to shave the rough stuff off anything large enough to split. It's the wood that makes it good.