need to know how to create the dialog box and each window
You can use a JDialog, see How to Make Dialogs.
Make each of your your graphs on a JPanel by drawing in the paintComponent method. See Performing Custom Painting to get started with drawing.
Add these panels to your layout which looks like a GridLayout.