Transfer bread to skillet and cook for 2-3 minutes on each side. Repeat for remaining slices of bread.

Melt ghee in a small saucepan over medium-high heat. Once the ghee has melted, add sliced bananas. Cook them until they are lightly browned, turning occasionally. Add brown sugar to bananas a little at a time while cooking.