document outline is the table of content view in right side of editor, enabled by the rightmost toolbar button in rmd editor. It will show the title/subtitle, chunk title, function name etc in hierarchy.

When you open a .md in rstudio, the document outline feature is not available. Since markdown document do have title/subtitle, an outline can be very helpful in navigating and overview.