"Good men must die, but death cannot kill their names."

I re-worked this essay for use in a lesson on evaluating information that I contributed to the University of the People a while back. The lesson contents haven't been openly published, but I feel this is one of the most beautiful works to have ever come from Searchlores, and will post it here so a wider audience might be able to appreciate its insights. While I may have never met the site's curator (known to me only by his pseudonym, "fravia+"), his works have contributed greatly to my development not only in the realm of technology, but as a person in general.

It's been almost a year since his passing, but the community of crackers, reversers, and seekers that gravitated around him thrives on. To them, I would apologize if any aspect of this adaptation seems to betray the spirit of the original.

Sielaff's Lessons

adapted from fravia+'s original version at http://searchlores.org/evaluate.htm

We sat there waiting and rather tense. January - quite cold in Berlin, but, after all, that was the reason we were there: Sielaff was still teaching.

And he did come - with his classical quarter-of-an-hour “academic delay.” He came in, leaning to one side, because he carried a dozen books under his left arm, and then he sat down without even looking at us and let all of his books fall onto the teacher's desk.

Mind you, this was the most cherished post-university course for historians of the early middle ages in Europe in those days, so you can imagine how silent and attentive we (students from all over Europe) were...

He still did not look at us. “These books,” he began, “deal all, more or less, with the same subject: the history of Denmark in the middle ages. Now, please try not to focus too much on the subject. Actually, the subject could be completely different - it would not matter in the least. The point is that you should learn how to EVALUATE all kinds of books BEFORE buying or reading them.”

Sielaff looked sharply at his audience. “I imagine,” he said, “you already know that most of the books and data around us are next to useless, don't you?”

I don't know about the others, but this took me by surprise. I had always thought, innocently enough, that anything that was published must have had some sort of “value.”

“This book,” Sielaff began, taking the first book from his pile, “is titled, quite appropriately for today's example: 'History of Denmark in the Middle Ages.'” He paused and looked at us. “Unfortunately, the Author, as stated by himself in the introduction, does not know Danish at all, therefore...” - he suddenly threw the book to a far corner of the teaching desk in disgust.

YOU CANNOT WRITE ABOUT SOMETHING WHICH IS LANGUAGE-RELATED IF YOU DO NOT KNOW THAT LANGUAGE

Obvious, but very often underestimated

“This book, on the other hand,” he continued, picking another book from his pile, “which is titled 'Denmark Between 500 and 1200,' has been written by an Author that actually does know Danish. Unfortunately, the same Author wrote - before this book - a book titled 'Cactuses and Other Desert Plants' and - should that not be enough for you - he wrote, a short time after having published the book I am holding right now in my hand, another book titled 'Aquarium Techniques for Home and Profit.'”

The book flew to the far corner on the desk, where it hit the previous one.

YOU CANNOT WRITE ABOUT UNRELATED THINGS AND PRETEND YOU REALLY KNOW SOMETHING ABOUT ANY ONE OF THEM

Obvious, but very often underestimated

“I am sure you are beginning to understand now...” he said, “but let's continue, because there is MUCH more to understand and reverse. Here is another book, 'Denmark in the Middle Ages'” - and he lifted a third book from his pile - “that has been written by someone who definitely knows Danish, who only worked on Danish history of the middle ages, and who happens to be a recognized authority in such matters.” He paused, and then threw the book, disgusted, to the “reject” side of his desk. “I know you won't like what I will say, but it is quite important anyhow: the Author wrote this book when he was only THIRTY years old!” In fact, we were all still approaching thirty ourselves. With the students speechless, he continued: “You won't enjoy hearing it right now, but believe me, if you want to be really sure someone knows anything about what he's writing about - especially in complex sciences like early medieval history - you wait until he is AT LEAST fifty years old, and even in that case you should take GREAT care; most of the so-called 'experts' are often enough just releasing hot air. This has nothing to do with Danish history specifically, of course... it happens everywhere.”

YOU CANNOT TRUST ANYONE THAT DID NOT SPEND A RELEVANT AMOUNT OF TIME ON A SINGLE AND SPECIFIC THEME

Obvious, but very often underestimated

“You see,” continued Sielaff, “the fact that the previous Author worked a lot on a single subject may be relevant for the books he wrote / will have written at the END of his career. But this does not guarantee anything at all about the books he may have written at the beginning. And now we come to this article, 'About Medieval Denmark' which was written by an expert on Danish medieval history when he was fifty. The article appeared in November, 1982, in a university monthly collection...”

Silence followed; we were trying to guess. “Ahem, I repeat: it appeared in November in a monthly...” More silence - we didn't know what to say. “OK, if you don't know it yet, then you better learn it right now. Monthly publications are tricky - especially university ones. They actually HAVE to publish their 12 issues year after year in order to survive and get public money for the following years. Yet, the quality varies considerably, and though it may be relatively easy to find some sound and interesting material for the first, say, five or six months, you'll have to scratch the bottom of the barrel to be able to fill and publish all 12 issues. Therefore, my dear students, everything published 'from September onwards' should be regarded with suspicion. Mind you - it doesn't MEAN that the stuff is useless, it is only LESS PROBABLE that you'll have some outstanding work there.”

YOU SHOULD ALWAYS TAKE INTO ACCOUNT THE ECONOMIC FACTORS BEHIND ANY PUBLISHING EFFORT

You should always take into account the economic factors behind anything

“And now we are approaching the heart of today's session.” Sielaff yawned. “Here you have another book: 'History of Denmark Through the Middle Ages.'” He raised a hand holding a thick book from his pile. “This was written by a recognized expert of Danish history, towards the end of his life, building on many essays he wrote before on the same subject. It was published by the most renowned Danish editor, and was translated into German, English and French.” Sielaff paused. “It has no footnotes, only endnotes.”

Sielaff coughed, smiling sadly. “This basically means that you should 'believe' the historical reconstruction of the Author, instead of having the possibility - and the ease - to verify his writings AT EVERY STEP.”

“So even the 'formatting' of your target resource is important as well, and please note that most of the time this formatting will NOT be casual.”

He threw the book away in disgust.

FORM MATTERS ALMOST AS MUCH AS SUBSTANCE. MOREOVER, YOU SHOULD ALWAYS CONSIDER HOW “OPEN TO QUESTIONING” YOUR TARGETS PRESENT THEMSELVES

Some Authors only refer to secondary sources, if ever. Others will bend backwards to avoid giving readers direct access to a primary source that could be interpreted differently.

“Today's introduction is almost finished. I guess you may enjoy this book.”

Sielaff held in his hands the last book of the pile. “Titled 'A Short History of Denmark in the Middle Ages,' this book was written by a recognized expert on the matter, 60 years old at the time of writing, has footnotes, uses the sources correctly... as far as I can judge, everything seems 'in order.' It has all the characteristics of a sound book.” Sielaff opened the book and sniffed among the pages. “It even smells good.”

Sielaff's head jerked back. “Yet, you should NOT trust its assertions - not in the least! Check the sources yourselves, confute the 'truths' and the 'discoveries' of this Author... think about the possible alternative interpretations." Sielaff hands waved in the air. “They're only WORDS! Never forget it: books, knowledge... just a cobweb of words; behind them, often enough, nothing. A cobweb of theories, that's 'science.' It's up to you to dispel it.”

Sielaff's eyes pierced the audience. “A critical mind - that's your only weapon inside the dark forests of bogus knowledge you will have to cross again and again. Your critical mind... never, ever allow it to get dull.”

Sielaff put the book down, closed it gently, and left.

NEVER EVER TRUST YOUR SOURCES ONLY BECAUSE THEY SIMPLY "APPEAR" TRUSTWORTHTY

A critical mind - that's your only weapon inside the dark forests of bogus knowledge. Never, ever allow it to get dull.