problem in managing layout

hello everyone,
I want to add jtextfields on button click at run time at specified location. i am able to do that but the problem is that, i am not able to shift the controls which are already present below the specified location. how to manage the layout for this?how can i do that?please help. ...... Thanks in advance.