It seems that you are trying to re-invent the wheel. Some very complex books, and entire encyclopedias, handle vast amounts of information with nothing more than a table of contents and an index.

If you title your various posts something like this: "Specific topic: Remainder of title," the Search Widget will let your readers find your Posts (not Pages) about the subjects they're looking for.

As for a table of contents, forget about the archive code. Instead you can set up a few Pages, designated for specific topics, each of which can contain hundreds of links (which you'd have to add manually). Each of those Pages can be divided into sub-topics, using a brief list at the start, coded to work as "jump links" to a specific section below. I do that at my blog. It works for me.