I agree that the Bulk Import Tool Jan is pointing you to is most likely the way to go.

With so many folders, you need to think carefully about the folder structure and how/if your users will be using Share to browse that content. If so, you may see problems for folders with more than 1000 direct children, depending on how you've configured the server.