In all the discussion about bibliographic data and catalogs, and about
their advantages or disadvantages when compared to other approaches, it
is striking how little appeal there is to actual evidence. Evidence
about value. Evidence about cost.

I found it worrisome that someone so high on the bibliographic food chain was saying this. My first thought was--isn't this what the Ph.D.s in LIS programs are providing for us "working librarians" who don't have the time or resources to do research? Tom's comments in, No evidence on bibliographic issues, makes a similar point:

I expect the framers of RDA are using a wealth of such research data
diligently compiled by the researchers at our library schools to
compile the rules. With this much academic research behind us,
Amazoogle doesn't stand a chance!

Having watched a fair amount of the Library of Congress Working Group
on the Future of Bibliographic Control’s 3rd meeting via live webcast
yesterday, along with attending the 2nd one in Chicago, toss in a few
other odd reports and such here and there, and one should quickly
notice that we have pretty much nothing but anecdote. Not a
damn shred of actual evidence for anything anywhere. Just a lot of
talking heads talking about what they think is wanted by users or about
what systems and data we need to supply that to them.

So, what are we basing these future of cataloging and catalog decisions on? Any thoughts?

Comments

You can follow this conversation by subscribing to the comment feed for this post.

Hi Christine --

Thanks for a very interesting blog!

I agree that empirical research, which is what I think people usually mean by "evidence," is essential. But what always bothers me is the derision of our ever-growing body of qualitative evidence, gathered over decades in uncontrolled, messy, and therefore real-life situations, which we deride under the heading of "anecdote." The two are not opposed means of learning, but should be complementary. Also, repeating "we need more research", while often true enough, can be an excuse for inaction, or even a stick with which to beat others' actual knowledge, experientially gained (that is, their "mere stock of anecdotes").

So what this comes down is that the dichotomy between empirical research-based practice and experiential knowledge-based practice is often overemphasized, and generally unhelpful, at least for me.

David, Thanks for this reply.
I think your point about undervaluing qualitative experienced-based evidence is excellent. I've learned a lot from my professional colleagues through this type of learning. Talking with them and learning from their experience has be invaluable. And one would definitely call this "anecdotal evidence." It's not like I was sending out a survey or anything. It was usually just a conversation or an email exchange.
Yes, the dichotomy of evidence vs. anecdote is not helpful (maybe I should delete this post!). But I also think that the future of cataloging and library catalog debate is often based on neither empirical evidence nor knowledge-based practice, but is instead purely speculative, wishful thinking. What I like to call "digital fundamentalism."

No, don't delete the post :-)! The topic comes up often enough, but isn't often examined in terms of underlying assumptions -- what do we mean by "research," what evidence do we value or discard, etc.

I agree, yes, there's a lot of wishful thinking. It seems to operate just as much in discussions of what we should (or must) stop doing, as in discussions of why we do what we already do.

All that said, it would be most helpful to organize, in a way, our day-to-day evidence in more rigorous -qualitative- analytical or descriptive frameworks. That would still respect the primacy of actual experiences, but make them more widely communicable.

I most certainly agree that some anecdote rises to the level of evidence, just as "real" empirical evidence can be misused.

I respect what David says and, in fact, agree with it mostly. I was not trying to emphasize some dichotomy between the two; anyone who's read me long enough would know that I generally despise supposed dichotomies and have yet to find a real one in the world.

But in the effort to redesign what it is we do I would hope that a bit more attention other than an "it's generally unhelpful" attitude would be paid to the quality of the evidence, whether it is unconfirmed anecdote or verified empirical data. There is room for all of it; but all of it must be questioned and not just blindly accepted.