Category: evaluation

Last in the current series of researching events, I want to talk a little about small events.

My religious community is the modern Pagan community (or rather communities: there are a lot of overlapping ones), and one of the things I know confuses people new to this thing we do is how to find out about and learn more about smaller events – the ones that happen weekly or monthly or seasonally.

(The same thing goes for people exploring new religious communities in other places, too. Or any other place that has its own culture: an exercise studio, an arts activity, moving into a new school as a kid or a parent, all sorts of places.)

Tacit knowledge

There’s a concept called ‘tacit knowledge’ – if you’ve been reading this blog, you’ve seen me refer to it before.

Tacit knowledge is, by definition, hard to explain in words or examples. It’s the things we pick up by doing things or sometimes by watching other people (either in person or through TV or movies) It’s what can help us feel like we know what we’re doing in a new situation – if what we’ve picked up is accurate and helpful for that situation.

You can probably see right away how this can also be a big problem.

Not everyone has equal access to tacit knowledge. Some of it depends on experiences you’ve already had (it’s easier to make a leap of understanding if you’ve done something similar).

Some kinds of tacit knowledge require you (or your parents or someone else near you) to have time, money, or resources to expose you to a particular thing – for example, how attending a live theatre performance might be different than movies or a sports event.

Exploring a new community involves lots of tacit knowledge.

Knowing yourself

Exploring a new community also works better if you know yourself well. Some people find entering a group of people they don’t know stressful at best and upsetting at worst. That makes it hard to relax or enjoy what’s going on. Other people like the chance to meet someone new, and don’t find entering a group event very intimidating at all. (I am not that person, but I am assured they exist.)

Some people are intimidated by a classroom or workshop setting, and find it makes them very anxious. Other people find the structure of that setting (which usually comes with a reasonably good idea of the topic to be covered, how long you’ll be there, and some of what you’ll be doing) to be very reassuring. I’m one of those people.

Some people don’t mind large groups, and like the chance to observe and interact as they choose, without people pressing them for conversation. Some people really prefer small groups, where a new person is noticed and welcomed (well, hopefully welcomed.)

Finding out about small events

This depends a lot on the community.

If you’re looking at a particular organization, start with their information. Depending on the org, that might be a website, a Meetup group, a Facebook group, some other form of social media, a mailing list, or something else.

Whatever form it is, a well-run event will do a few things. They’ll tell you when the event is happening, a rough outline of what will happen at it, and what you should bring or expect. If you don’t see the things below, with enough advance time for you to make appropriate plans, then either give the event a pass this time, or at least go into it a little cautiously.

1) When the event is happening (with enough warning)

People have busy lives, and may need to schedule other things – if you tell someone about an event that takes place a few times a year a week or two out, a lot of people may already have plans, or have been scheduled for shifts at work, or need to sort out children’s schedules, or all sorts of other things.

The same guidelines go for special events at something that has a regular schedule (for example, special services at a religious community that has weekly meetings.)

If an event is always at the same time, and happens monthly or more often, you can just let people catch up when they can. If it’s something like a Sabbat ritual (eight times a year, roughly 6-7 weeks apart), then letting people know when it’s scheduled at least a month in advance is nice, even if you follow up with additional details later.

2) The event’s schedule

Depending on the event, there may be a time people gather (i.e. the space is open and you can get in the building), a start time (maybe after this time no one else is allowed in) and often a time that everyone has to be leaving the site.

There may also be a time for a social hour or potluck or other community event (often with food, that’s my next topic.) and it’s nice to let people know the split between the main activity and the social community time (which is also important, but usually more flexible if you need to leave early.)

3) Tell you about what to bring and expect

Different communities have different customs. Some places pass a donation bowl (so in our increasingly cash-free society, you may want to make sure you have a suitable amount of cash to drop in). Some places have a potluck. Some may want you to wear certain clothing or not wear certain clothing, or bring certain items or not bring some items.

A well-planned event will tell you these things, or at least provide some way for you to find out. It’s also great if they provide basic accessibility info and how to find out more, too.

Sometimes this information will be in the announcement itself. Some events (especially ones with the same general information most of the time) will have it on the website (maybe under a link for first time visitors).

If you have questions, events should also have a way for you to check in with someone in advance.

Once you’re there

Of course, part of evaluating an event involves being there. Usually there’s less sizeable investment on your part in an event that happens regularly or repeatedly. At the same time, that’s no excuse for not looking for how things are going.

Well run events usually stay roughly on schedule (or if they’re running late, they’re specific about why). They’ll often build a little bit of flexible time in the beginning, so that if something runs late, they can adapt.

Again, you’ve likely been to other events sort of like this, and you can use all that past experience to evaluate how it’s going. Do people seem welcoming? Do they explain where things are or help you figure out what you need before things start? Does the event do what they said they would? The specifics are going to depend a lot on the type of event – a networking coffee meeting is different than a religious service is different than an educational workshop, of course.

In my previous post, I talked about researching events. This time, let’s look at some specific things to evaluate when considering events.

Why am I going into this in this much detail on a blog about research? First, it’s helpful (and I like being helpful!) but it’s also a concrete thing to evaluate, because we all have some experience in the physical world, and how some things work there.

Learning how to evaluate specific points with things we know something about helps us learn skills we can use when we’re evaluating things we know less about (like new information or subject areas.) It also helps us learn to ask better questions, which can guide our research.

Information wants to be available

(Or rather, people planning an event should want to make it easy to find the important things about the event.)

One big warning sign – for events, for people, for research – is information that is seriously insufficient for what the resource wants to be able to do.

A well-planned event will want to tell you important things so you can make decisions about your plans in good time. They won’t make it terribly hard for you to find things like where and when the event is, practical details like what you should plan for, or any costs.

A poorly planned event, however, will often talk up guests or big plans – but they won’t mention exactly what those guests are going to be doing or focusing on (which makes it hard to plan.)

They may mention dozens of panels or activities, but not provide any kind of schedule in advance. They might talk about accesibility or inclusion, but not actually provide advance information about accessibility resources (or ways to ask) or think about different parts of the community.

No event can be all things to all people – but the good events will give you lots of information up front so you can figure out if it’ll work for you, if you need to ask some more questions, or if it’s not a great fit for you (at least at the moment).

You’ve probably known people in your life who talk up a thing, and don’t have follow through. You can apply the same skills here. If something seems a little weird to you, follow up further.

Where is that information?

Another warning sign is for an event of any size that doesn’t have some sort of stable web presence. Facebook and Twitter (and other forms of social media) can be good ways to get the word out, but there are plenty of people who don’t use them, or who don’t use them for parts of their life.

(I use Facebook for professional reasons, but avoid things that make my religious life obvious there.)

It can be really hard to find current information on a lot of social media sites – so if that’s the only place an event has a lot of information, people may miss important things or necessary details. That’s no good for anyone.

When is that information ready?

First time events often don’t leave quite enough time for programming information to be finalised, or they may have changes up to the last minute (if they have open slots, they may add things, or people may need to change plans and can’t do what they signed up for.

This is somewhat less common with large well-established events, but even then guests can get sick or have unavoidable conflicts come up.)

The plans are based on a sensible foundation

It’s a rare event that starts out and can have a couple of thousand people there the first year. Most first year events start with a couple of hundred people at best – and sensible event planners will start there.

Ambitious plans can be very attractive – but they’re one of the easiest ways for events to go wrong.

Think about the money

Some of it’s about money. If you are touting an event as really big, you need a place to put those people. Big event spaces cost a lot of money, and come with a lot of other complicated commitments (like AV and technology rental, stages, things like tables and drapes and chairs.)

With smaller groups and smaller spaces, you often have a bit more control over what you need to spend money on, and what you can find some other options for.

Even a small event (off-season, in a modest amount of hotel space that is not competing with wedding parties) can run $10,000 very easily, and often quite a bit more. So just because an event has raised a lot of money, doesn’t mean they have enough to make a huge event.

Some costs associated with the event are things that it’s hard to estimate if you’re not familiar with event planning in general (to have a sense of the range of things that will cost an event money) and the place the event is taking place in specific (because there are tons of regional or even neighborhood differences).

But you can spot some of them, like “More guests probably involves a lot more money” and you can make some rough napkin calculations about likely amounts for plane fares and hotel room nights for guests based on details the convention tells you. If those don’t seem to add up, you can tell other stuff might not either.

And about the infrastructure

It’s not just about money (though the money is an issue too). A big event needs a lot of infrastructure.

Running operations takes some people – someone’s got to register people or check them in, and be available for operational help (the AC is on too high, it’s too hot in there, we’ve run out of water, do you have some tape?) But someone also needs to be on hand for more complicated needs like managing high-demand lines or events, or providing security.

If there are party rooms, alcohol, competitions, or special guests who attract a lot of attention, you probably also need some kind of security or at least a plan for people to circulate and make sure things are going legally and smoothly.

Who’s providing medical support if medical issues come up? Smaller events in hotels or other rented buildings may not need anyone specifically focused on it, but bigger events or outdoor events do. Even in a hotel-based event without particular physical risks, a group of a few thousand people has a decent chance of someone having a significant medical issue during the event. You want the event to be thinking about safety concerns, and especially to be clear about options for events that are at campground or festival sites, have significant outdoor activities, or at times of year when things like heat exhaustion or cold might be a problem.

Competent staff don’t grow on trees – so where is this event getting them from? A lot of events run on a lot of volunteer help (especially for things like badging, supporting programming or panels, or the vendor/dealer room or art show). Where are those volunteers coming from? Is there a known number of people who are steady, going to show up for their shifts, and ask questions if they’re confused?

This list is woefully incomplete, but it gives you an idea of what to be looking for.

Follow the numbers

There are three sets of numbers you should pay attention to, especially for a new event. These are the advertised number of attendees, the number of guests, and the cost for the event.

Number of attendees

I touched on this one above, but it’s not that common for events to start big. Most events – even the ones that are now 5,000 or 10,000 or 20,000 people, started much smaller (often just a couple of hundred). Plenty of successful ongoing events started with a hundred or two hundred people in a reasonably sized rental space, and grew from there.

If an event’s success depends on it starting large – or if you see lots of urgent pleas for significant numbers of tickets – that’s a time to look closely at your options. Make sure you won’t get stranded if something goes wrong.

Number of guests

Bringing in guests is usually a significant expense for a convention – even the ones that are not big media conventions. It has to be worth it to the guest to give up their time (and for authors or other creators, it can often be a big disruption in their work schedule to be away from home from Thursday or Friday through sometime on Monday.)

It’s common for even very small conventions to offer their guests of honour at least housing, a food stipend, and often also transportation and at least a small honorarium. (Extremely popular guests, guests associated with big media productions like movies or major TV series obviously may have a lot of additional requirements).

Guests also involve time and infrastructure from the committee – someone needs to be focusing on where the guest is and needs to get to, that everything is ready for them, and to make sure the guest gets a chance to eat and sleep without disruption.

You can see why most small conventions often have one or two guests of honour. They may have other featured presenters, panel moderators, or people doing other programming, but usually those people are not getting the same sort of support from the convention.

So if you see a long list of special guests or guests of honour, be a little cautious. Or maybe a lot cautious.

Unrealistic funding streams

A lot of new events want to give everyone a discount! And yes, rewarding your early backers is great, but doing it with things that take money away from your event is not so great.

Take a look at similar events in the area, and what they charge for memberships or tickets or specific kinds of activities at the event. The chances are pretty good that a brand new, unknown event is not going to make a better deal for space rental or other kinds of expenses than a known event that’s been doing this for a while.

(Known events who bring in solid income for a hotel or conference center every year can sometimes make some really great deals – that can help them keep costs low, or bring in more guests, or do more special activities. But you need to build up a reputation of being easy to deal with and lucrative for the other businesses involved, first.)

If you see an event that’s half the price of similar events in the same area – what’s different? Sometimes you can figure out (One event is not doing a lot of expensive things that are at the other event. They’re in different seasons, and one of them is high tourism season or during some other regional big event when hotel prices are high, or whatever.)

If you can’t figure it out, be cautious of events that seem too good to be true. They quite possibly are.

Similarly. if the event is relying on crowdfunding, look for what the rewards are, and if those make financial sense for the event. It doesn’t make sense for an event to give rewards that take a lot of the money it needs for the event, does it? (That’s things like highly discounted attendance, or hotel rooms, or other big discounts.) Those things make sense if someone’s pledging a lot of money (like 10 times the amount of the ticket) but not just for the ordinary ticket price.

You will often see a wide range of ticket prices over the course of the event – that’s normal. Many events have an early bird registration that’s significantly cheaper, sometimes half the price of a later membership, to encourage people to register early and give them seed money for deposits for the event.

As it gets closer to the event, prices go up. But events should be pegging the costs so that their cheapest prices still would cover the expenses per person of the event, at a bare minimum.

Lots of us want to consider going to events in our communities. Lots of us aren’t sure if that’s a good idea. It seems like it’s a good time for a guide to researching events (and the people running them.)

This will be a series of at least three posts (this one about larger events, one about warning signs for larger events, and one about smaller more regular events.) If you’ve got questions, let me know, I’m glad to work them in.

My background

I’ve been part of a number of convention-type events, in different roles, as well as attending a reasonable number. Most of my experience is with smaller events (in the 100-300 person range) and most of my committee experience is as Hotel Chair, but I’ve also been in charge of Programming in the past.

One of those events (Paganicon), is one I was part of founding, and on the committee for the first few years, until I moved out of state, so I’m also very familiar with ‘how do you create an event that starts at a sustainable level so you can build on it’.

Why am I thinking about this now?

If you’re in fannish circles, you may have seen the recent news about UniversalFanCon announcing a week before the convention that it would not be happening (it was scheduled for April 27-29, 2018, the announcement came out on Friday, April 20).

This has left a huge number of people – vendors, people on programming, attendees – scrambling, and likely out significant money for travel, expenses, etc. It’s particularly painful for people who’d been looking forward to a con that was specifically aimed at fans of colour and people from marginalised groups within fandom.

I’m not going to rehash the details here (and as I write this, more info is coming out) but that’s the context for why I’m writing this post this particular week.

Get a sense of the event

The starting point for learning about an event is a little research. A larger event probably has a website, which should have some key information about the event.

When is it? (not just dates)

Where is it? (with relevant transportation info if relevant)

Who’s running it? (more on this in a second)

What will be happening? (at least an overview)

Any special guests, activities, or high points.

Other important details (depends on the event)

It’s really easy to make a splashy, well-designed website that doesn’t actually tell you important information. You want to check into what people say, not just how it looks.

It is very common for different kinds of information to be shared at different points – the timeline that follows gives some idea of when specific pieces of information should be available. If it’s not, that’s a good time to take some steps to protect your options and ask some more questions. You may also find some information more easily on different forms of social media (like responses on Facebook, or crowdfunding pages, or other sources.)

Overall, you’re looking for clear communication about necessary information, consistency about how they talk about details, and to have some sense of how much experience they have in the community in question and with planning events.

Who’s running it?

One big question for events – and especially new events – is “Who’s running it?” This is one of those questions that can be hard to figure out if you’re not familiar with the people or with that kind of event.

Unfortunately, there’s no way to be certain about this, but some research can help.

Start by looking at who’s putting the event on. This can be an existing group, or it can be individuals.

Existing group

If it’s a group, what other kinds of events have they put on? Sometimes a little research will turn up the fact this is an ongoing event. If so, try some searches on phrases like the event name and previous years (or using date limiting in your search to find a specific year.) If there are posts, they’ll probably be in the first month after the event.

Individual people’s experiences with an event will obviously vary a lot, but you can usually get a sense of whether the event was reasonably well managed, people were responsive to concerns, and things went more or less as planned.

Moving from a series of open afternoon events to a day-long event to a weekend event is a pretty common progression, and allows the group as a whole to learn more about what they can do well in manageable stages – even if the individual people involved change over time (as they probably do.)

Want to know how to limit by date? Currently, in Google search, try a search on your terms. At the top of the page, just under the search bar, on the same level on filtering results by all, news, images, videos, etc. there will be two options that say settings and tools. Click on the ‘tools’ and you should see options to limit your search by ‘any time’ and ‘all results’. Click on the one that says ‘any time’ and you can choose other options, like the last week, month, year, or custom dates.) Other search engines may have similar features, if you look around a little or check their help information.

Or is it a new set of people?

If it’s individuals working together on a new project, take a look at what other projects they mention. What can you find out about those projects? Do they seem to run smoothly? Are there people involved with specific experience in running events that you can check out?

Lots of people successfully run organizations or blogs or websites or podcasts or other projects, and many of those organisational skills do transfer to running events. But events have a number of their own considerations, so you really need some people in the mix who have experience running events well.

Someone needs to make sure that all the needs for the space are handled well (whether that’s a hotel or a festival campsite), and you also need people who can coordinate volunteers, manage funds, and some other more specialised tasks, some of which have big legal, safety, or financial implications.

If you have a list of people, and none of them mention that experience explicitly (or not enough for the event!), that’s a time to be a little cautious. Check out their bios, but also try some searches on the names they use, and other events they mention being involved with.

If there’s a long list, focus on the experience of the people listed for operations, logistics, hotel, and the convention chairs, plus anything else that might have legal or safety implications, like performances, security, or food. Programming matters too, but it’s usually a lot easier to come up with awesome stuff to do on the fly if it’s planned badly than it is for someone with no hotel experience to sort out hotel problems.

In most groups of people doing this kind of thing, you’ll have some people with more experience, and some people who are new to a thing. You want some signs that the people new to it either have guidance from the chairs (who have extensive experience) or that there’s some other method for getting advice (especially for the roles I just listed.)

Special note for Pagans: This can get particularly complicated in the Pagan community or some other places, since many people use a public Craft name for privacy reasons – and that may not be the name they use on social media. Events may not list their staff explictly by name or photograph. Finding dead ends isn’t automatically a reason to worry, but it means you want to check into other information more carefully.

Guests and activities

Check out those people (even if you’re not really interested in what they do). Do they make sense for the skills and size and scope of the event?

What do they do?

Does it make sense for them to be at this event? Here, you want to look both at what they do, and their general status in the field.

Major celebrities probably won’t be at a tiny first-time event (even with a fairly strong personal connection it’s pretty unlikely.) Moderately well-known authors or artists who do the thing the event’s focusing on are a lot more likely (or the equivalent in other fields.)

How many guests are there?

Somewhere between one to four main guests of honour is pretty common for small to moderate size events (up to about 1000 people), especially if they’re fairly new events. If there are more than that, look closely at the event’s track record so far.

Be cautious about events that list a lot of guests, especially if they’re new. I’ll go into this more in a future point, but here’s the summary. Guests of honour are great, but also expensive for a new or smaller convention, and making the experience good for the guest also involves a fair amount of volunteer time and committee attention – both of which are often finite resources in practice.

Is the guest’s visit to this event mentioned on their own site?

This may take a while to update, but if most guests don’t have the information up on their own information site by three to six months out, that’s a big warning sign.

Most people who do GOH or other featured guest slots will put it up on their site once they have an appropriate agreement about what they’re doing at the event. If no one’s posted it on their own site, that may be a sign those agreements don’t exist or aren’t final.

(Note this is different for people who are on panels or leading panels or aren’t featured – some of them may announce it, some may not, or not until programming is announced. I’m talking here about the big featured guests who are supposed to be a significant focus or draw.)

A general timeline

Obviously, you want to find out about the event early enough that you can make plans to attend. Event organisers should be thinking about this. For yearly events like conventions and festivals, the organisers need to start planning at least a year out, so some basic information should be available that early.

Here’s a reasonable timeline for what information you should find when. Well-run events can vary a bit from this, but usually it should be clear what’s going on if they do. (For example, not all events have a big central activity or have guests of honour as a big draw.)

You also want to look for whether they meet their stated deadlines – if they say they’ll have their programming schedule out at a certain date, does it exist or do they make a note about when it will? Or does it just not exist at all?

A year out:

For yearly events, the next year will often be announced at the current year’s event, or shortly after. If you don’t see specific dates by eight months from a yearly event, that may indicate problems in finding a space.

Four to eight months out:

Somewhere in this range, you should start seeing a lot more specific details. If you don’t see most of this by four months from the event, that’s a good time to be a bit worried. People need details to make their plans.

Major guests, events, activities:

These are the things that may make someone want to go to this event over other possible events, or bring in people interested in a specific author, creator, or focus. Basically, if they want you to buy a ticket for a special event, or are using someone as part of their advertising, you want to know around this point.

The site may not list what the guests are specifically doing (such as the precise title of presentations or workshops) but you should have a good idea what kinds of things they’ll be offering. Is it signings? Meet and greets? Panel discussions? A concert? A mix?

How you can participate

Events have very different schedules for arranging other programming like panels, workshops, or discussions. Some events have more structure to their programming and plan a long way out, others will take ideas up to a month or two out from the event.

Events also often want to have vendors or other things (like artists for an artists alley). These people need to plan their calendars in advance, and fees for their tables can be a big part of the income stream for the event.

Most events also rely on volunteers for various tasks, and a well-planned event will let people know about the range of tasks and how to get involved well in advance, so people can plan their time.

Whether or not you want to do any of those things, you want to look for events that let everyone know what the process and deadlines are, and where that timeline makes some sense with other things they say.

Other useful information

Events should at this point also have information about accessibility needs, or things like what if you have children (Do they need a membership? Is there childcare or children’s programming?)

If there are food events, the information should have some general information about what they are planning and how to let them know about any specific needs you have. This is also a good time for the event to let you know about other food options or forthcoming information like a restaurant guide.

Some details may still be in process, but you want to have a sense at this point that someone is thinking about that, and that there are plans in place for common needs or questions.

One month out

Any information people need for plans at the event should be available around now. Some events are lousy about getting their programming schedules up (and sometimes there’s some slippage because people are working out logistical details that get complicated) but you want to see some sense of what’s happening when.

This is also a good time to expect to see things like area food guides, any additional transport/location details (like specifics for shuttles from the airport) or any other important info.

If you don’t see this information, or it doesn’t have a clear date it will be available, that’s a good time to ask some more questions, and make your own plans so that you won’t be in a bad place if some of the details aren’t handled well (Can you change travel or hotel arrangements with less of a penalty? You might make different choices about shipping materials as a vendor, or see if you can make backup arrangements for your event.)

I got nudged by a friend to do a ramble about information evaluation. It might have gotten a little away from me.

Basic principles:

We all have biases and things we know more about than others.

Some people are more up front about this than other people.

Ditto goals. We all have them, some people are more up front about them.

Be really suspicious of the people who claim they have the absolute truth and are telling you for your own good.

(They probably don’t and they probably aren’t. Especially if you don’t have a preexisting trusting relationship. Real world stuff has fewer absolutes, for one thing.)

Who is this person (or What is this source?)

Start with the basics. Who’s telling you this thing? What’s their background? If it’s a website without an individual author, what do you know about the site?

You may need to file this in “Need to do some more research” but knowing you need to do that is a great first step. First thing: check out the ‘about’ page, or a bio. Usually this will give you some hints on what they’re about and what they care about most.

If you’re not sure where to start with that, try searching the person’s name (plus maybe a term from the topics they write about, if you need to narrow it down) or search on the name of the site. Sometimes adding in words like ‘review’ or ‘about’ will help.

Even just knowing what kind of source this is can help. Personal website? Newspaper that’s actually well-known and reasonably respected (even if you don’t agree with them)? Pocket of internet culture you weren’t previously aware of? Political group hidden behind astroturfing techniques?

I sort things into “Probably reasonably competent”, “Dubious” and “Need more information”, personally.

Probably reasonably competent sources are those I’ve checked out before, and came up reasonably well sourced. I still need to check the specifics here, but they get some starting benefit of the doubt. Dubious sources are those that have come up short before. Everything else gets filed in ‘need more info’.

What are their goals?

Education? Information? Sell something? Share something gorgeous or fun or amusing? Are they trying to persuade you of something?

What do they get out of you believing them and taking them (or their information) seriously? Are they being up front and honest about that?

Here’s an example: sales sites are not the most fun thing ever, but there is something refreshingly honest about “Buy this thing from me and here’s why.” It’s clear what the people want, and usually pretty clear what’s involved in getting it.

On the other hand, a lot of sources in the political realm are trying to persuade you of things, but it’s not always clear what they’re trying to persuade you of. (Or whether they’re not trying to persuade you at all, but are instead signalling to their core base what they care about.)

This is often where you see a lot of vagaries and unsourced information that plays on emotions rather than treating you like the intelligent, thoughtful, considerate person I want to think you are.

Where did they get their information?

This is where we get to the meat of things. People who are saying trustworthy things should give you a way to check, or more information about how they know that.

When we’re talking to a friend, we put what they tell us in the context of all the other things we know about them. They’re reliable as anything with a ride when it’s important, lousy at getting stuff to the post office.

They have a lot of specific experience in dealing with Mercutian rabbits, and the last fifty things they told you about those rabbits turned out to be right, but they’re not nearly so reliable about Venusian wombats. And they’re normally great about Saturnian leopards, but there’s this one weird quirk, don’t trust their grooming recommendations.

When we’re reading a random website, we don’t have that. We can’t put some of what they’re saying in context without more information.

That’s why their sources matter. Do they tell us where they’re getting their info? If it’s unnamed experts and sources, be dubious. (Though there’s a link below with some more about how to evaluate this with more nuance.)

If they claim specific expertise, can you verify that or does it seem in line with what someone with that expertise would say? (If someone claims to be a lawyer or doctor or librarian and says stuff that is way outside what you’d expect, be dubious without more specifics. Maybe a lot more.)

When is this information from? Is this a topic where currency matters a lot? Some topics change fast, some don’t. Sometimes the info that debunks a current thing has been around for a while (so older info may still be helpful in sorting this out.)

What kind of source is this, and is the information presented in a way consistent with quality information in that kind of source? Reputable newspapers don’t generally go in for explicit personal insults or completely unverified sources. (Unless they’re quoting someone who used one.) Less reputable current events sources might.

Expect better of where you go to learn things. If they’re not giving you meaningful information, go to sources that that will. You can do better than speculation and gossip.

Other key tips

Beware of absolutes, especially in complex situations.

There just aren’t that many absolutes in the world. This is especially true when looking at expert statements: few experts will give 100% certainty. If they do, they will likely also be explaining why. Look for that explanation.

If a media source says something absolute, check into what the experts actually said, and what information they looked at to get there. Chances are pretty good the expert was not nearly so absolute about things.

Be dubious of things that are too good to be true, too weird, or too perfect.

Again, the world just isn’t like that very often. The more we realise that we live in a world that has a lot of shades of colour and nuance and different experiences in it, the sooner we’re going to get better at evaluating information effectively and using it well.

Is this a situation where there are strong emotions?

Sourcing is often not the top priority in these cases. Which is understandable, but just because someone’s having emotions all over the place doesn’t mean you have to use everything they tell you as the basis of your decisions.

Emotions don’t mean someone’s wrong, mind you.

It is, for example, pretty reasonable for someone to be emotional about a topic that has a major impact on their daily life, health, safety, family, or religion, if other people are treating it as a purely intellectual discussion. But a story that’s playing on your emotions to make you feel upset or riled up or righteously victorious, you should be suspicious of that.

If emotions are in play, and you’re not in the middle of the discussion, it’s usually better to pause and take a moment to look at what’s being said.

Who has real experience with this thing? Who doesn’t? How does what people are saying match up with other kinds of information you can find or your experience of people or situations? Who has what at stake? Is this a real person who has specific experiences, or is it a made up storm of emotion that’s trying to get you to react a certain way?

This is only a beginning – there are lots of nuanced issues involved in how we find and evaluate information I haven’t even touched on here (like who decides what gets researched that you can refer to later.)