Hill Garden

I have a hill that I killed the grass on and weeds have taken over. I want to grow something that will come back every year and that is nice to look at. On the top of the hill though, the lemongrass and creeping charlie are taking over. What should I do?