Baker's music has been compared to that of John Prine. Baker's 2013 album, "Say Grace," was listed by Rolling Stone as one of the top 10 country music albums of 2013. In his review of the album, Jim Fusilli wrote "In Mr. Baker's tales, the personal becomes universal through his keen-eyed writing, supported by well-chosen instrumentation and what might be called spoken-word melodies."