Yep, that's a limit of the 3rd party Window Docking component that I'm using in TeSSH. The Close button isn't shown when tabs are present. I try to make the window more consistent...last (bottom) is where it should be.

I can also put a close button on each tab itself if you think that would be useful. I generally avoided that because it makes it too easy to accidentally close a session.