Subscribe to SearchCap

If there’s anything I particularly hate when it comes to SEO, it’s the meta keywords tag. I so wish it had never been invented. It’s practically useless, yet people still obsess over it. In this article, I’ll explain more about why you shouldn’t worry about it except perhaps for misspellings, as well as which search engines support it.

The meta keywords tag is one of several of meta tags that you can insert into your web pages to provide search engines with information about your pages that isn’t visible on the page itself. For example, my Meta Robots Tag 101: Blocking Spiders, Cached Pages & More article covers how you can use a different meta tag — the meta robots tag — to block pages from being indexed. Users don’t see this information (unless they look at your source code), but search engines do.

Meta Tags & Your Header

Meta tags go within the header area of your web pages. A typical head might look like this:

The header is the section that begins <head> and ends </head>. Between those elements, in our example, you have these tags:

Title: The text here becomes the title that is shown in search engine listings, in most cases.

Description: The text here is text that search engines sometimes use as a description for your web page when listing it (a meta tag lesson for another time).

Robots: This particular tag is configured to ensure that the page isn’t described using the a description that the Open Directory might have for it (Meta Robots Tag 101 explains this more).

Keywords: This tag is the topic of this article, so read on!

History Of Meta Keywords

I’ve long written about search engines and meta tags, but I have never been able to pin down exactly who created the meta keywords tag. There’s a December 1995 internet draft memo that’s the earliest and most authoritative mention of the tag I know of. It says:

<META HTTP-EQUIV= “Keywords” CONTENT= “Italy Product, Italy Tourism”>

The spaces between a comma and a word or vice versa are ignored….

These ‘keywords’ were specifically conceived for exhaustively and completely catalogue the HTML document. This allows the software agents to index at best your own document. To do a preliminary indexing, it’s important to use at least the http-equiv meta-tag “keywords”.

Sounds good, right? Like this is designed for the search engines to use? The issue is that HTML specs like these (especially drafts) are not necessarily used by the search engines. They can use them, ignore them or build upon them as they see fit.

As it turns out, several of the major search engines got together in May 1996 to talk about meta data. That meeting gave birth to a common standard for the meta robots and the meta description tags. As for the meta keywords tag, it was discussed, but no specification emerged.

Despite no specification, both Infoseek (later Go.com, these days no longer crawling the web) and AltaVista (now owned and powered by Yahoo) offered support for the meta keywords tag in 1996. If you looked at their help files at the time, they encouraged site owners to use the tag. Inktomi (now owned by Yahoo) also provided support when it began operations later in 1996, and Lycos (no longer crawling the web) added support in 1997.

That year — 1997 — was the last year that the meta keywords tag enjoyed support among the majority of major crawlers out there (4 out of 7 – Excite, WebCrawler and Northern Light, also crawling the web that year, did not support it).

Support Dies Off

When new search engines emerged in 1998, such as Google and FAST, they didn’t support the tag. The reason was simple. By that time, search engines had learned that some webmasters would “stuff” the same word over and over into the meta keywords tag, as a way of trying to rank better. At the time, search engines didn’t rely so heavily on link analysis, so page stuffing like this was more effective. Alternatively, some site owners would insert words that they weren’t relevant for.

In July 2002, AltaVista dropped its support of the tag. That left Inktomi as the only major crawler still supporting it, causing me to somewhat famously in the SEO world to declare the tag dead, since it was no longer a major ranking factor for even Inktomi:

Traffick.com’s Andrew Goodman wrote recently in an essay about meta tags, “If somebody would just declare the end of the metatag era, full stop, it would make it easier on everyone.”

I’m happy to oblige, at least in the case of the meta keywords tag. Now supported by only one major crawler-based search engine — Inktomi — the value of adding meta keywords tags to pages seems little worth the time. In my opinion, the meta keywords tag is dead, dead, dead. And like Andrew, good riddance, I say!

Since that time, Inktomi was rolled up into Yahoo, which continues to support the meta keywords tag as part of its Yahoo search engine. Or does it?

Search Engine Rep Confusion

Last month, I moderated a panel of search reps when that perennial favorite question came up during the session. Who supports the meta keywords tag?

Sigh. But if this question still coming up wasn’t depressing enough, then the search engine reps starting responding with a load of confusion. To paraphrase:

No, we don’t support it. Well, we read it. We read it, but it doesn’t matter. Actually, maybe we don’t read it.

Even Evan Roseman from Google said at one point that Google reads the meta keywords tag, suggesting no doubt to some that Google uses the tag.

To be clear, Google doesn’t. I’ll prove it further below, but it doesn’t, OK?

I gave Evan (hopefully) some good humored hassle afterward for saying this. He’s at least the second Google rep to declare this on panels I’ve moderated in as many years, and the problem is that the engineers (from any of the search engines) often take the question too literally.

Indexing Versus Retrieval Versus Ranking

To understand, let me talk about three different things a search engine does when it crawls and lists your page:

Indexing: This is where the search engine effectively makes a copy of your page. The search engine is going to read and store the HTML content it finds — all of it. Evan was right when he said that the meta keyword tag is indexed by Google. Google knows that the tag exists and has recorded what’s in it. But that doesn’t mean it does anything else with it.

Retrieval: This is where the search engine finds all the matching documents relevant for what you searched for. Most of those documents will actually have the words you searched for on them, in the sections that the search engine searches against (there are some exceptions, such as when anchor text is used to find pages. Google Now Reporting Anchor Text Phrases, Google Kills Bush’s Miserable Failure Search & Other Google Bombs and Google Declares Stephen Colbert As Greatest Living American explain more about this). While the search engine has recorded the entire page, it won’t search against everything indexed for retrieval. In other words, Google will look to see if words you searched for appear in the body area of a document, but it will NOT look in the meta keywords tag for matching words. The keywords tag, while indexed, is not used for retrieval at Google. At Yahoo, it is.

Ranking: This is where the search engine looks at all those documents retrieved for a search and puts them in order of most importance, according to its algorithm. Retrieval (or what information research professionals call “recall”) is about finding everything). Ranking (or what the IR folks call “precision” — see Tim Bray’s excellent On Search: Precision and Recall document) is about getting the best stuff up to the top. Yahoo, while using the tag for retrieval, really doesn’t assign much weight to it for ranking.

Testing For Retrieval

Back to my panel experience. Since the reps were unclear, I declared to the audience that I’d just go out and test it again myself. It’s literally been about five years since I’ve last tested the tag, because I (and many others) feel it is so useless. There are better things to do with our time. But since that question needs a big old stake to the heart, I rolled up my sleeves and got cracking.

I had searched for all of these words on the four major search engines of Google, Yahoo, Microsoft and Ask and found no pages that matched. If these search engines made use of the meta keywords tag, I’d know in short order, if my page started coming up.

It took two days, until August 30, for Google to show the latest version of my page in its index. I searched for each of the words, and my home page didn’t come up. The meta keyword tag was not used for retrieval and thus not supported.

Microsoft Live: No

It took five days, until September 2, for Microsoft to show a version of my page with the meta keywords tag on it. As an aside, Microsoft is kind of annoying. It will say something like this in the cached copy of the page:

This is a version of http://searchengineland.com/ as it looked when our crawler examined the site on 9/2/2007. The page you see below is the version in our index that was used to rank this page in the results to your recent query. This is not necessarily the most recent version of the page – to see the most recent version of this page, visit the page on the web.

If you glance quickly at the date, you might think the page has been revisited fairly recently. But as the text explains, it might be older. Indeed, when I looked on September 2 (as is the case today), the copy of the page in the index was as of August 30, as I could tell from the stories shown.

As with Google, I searched for each of the words, and my page didn’t come up. The meta keyword tag was NOT used for retrieval and thus not supported.

Yahoo: Yes

It took two days, until August 30, for Yahoo to have my latest page. Searches there did bring up the home page for all words. So the meta keywords tag IS used for retrieval.

Ask: Yes

Ask took the longest to show the most current version of my page, not reflecting the changes until today. Actually, when I look at the cached copy even now, it says that the page is from August 13 and uses a redirection URL rather than my http://searchengineland.com address.

Still, I can tell Ask has a version with the meta keywords tag on it since I’m getting back my home page when searching for words in that tag. As with Yahoo, the meta keywords tag IS used for retrieval.

Should You Use It? Sure, For Misspellings

So there you have it — half of the major crawlers (Yahoo & Ask.com) DO support the tag. Should you begin using it? My advice would be only for misspellings and really unusual words.

As explained, the tag can help with retrieval. A word in the tag is treated as if it were a word visible on the page itself. Now that’s handy for misspellings. For example, say you’re writing about Basset hounds. You suspect some people might misspell the name as Bassett hounds, adding an extra T. You could misspell the word yourself on the visible page, but that makes you look bad. You could insert the word and then try to hide it using CSS styles or putting it in the same color as the page background. But this type of “hidden” text is generally against search engine guidelines.

Enter the meta keywords tag. Just do this:

<meta name=”keywords” content=”bassett” />

Now you’ve got the misspelling on your page in a “legal” means that will be read by Yahoo and Ask. You’re still out of luck for Google and Live.com, but two out four ain’t bad.

But I Want To Rank!

What about ranking better with the tag. I mentioned already that many experienced SEOs don’t find it useful. Believe me, if just putting a single word into that tag was going to rank your page better, everyone would be doing it. Instead, search for anything on Yahoo or Ask. You’ll see plenty of pages ranking well for words without those words appearing in the meta keywords tag. And if you do see the words in the tag, it’s more due to coincidence — the words also appear in the body copy, in the title tag and often in links pointing at the page. The words in the meta keywords tag aren’t the primary reason the page is ranking well. Promise.

Back to our Basset Hound example. Sure, you can add the correct spelling to your meta keywords tag. Go ahead, if you want. Just understand that it is not likely to make you rank any better than if you didn’t include it at all. Moreover, beginners are especially likely to spend far too long worrying about getting the “right” words in the meta keywords tag rather than just writing good body copy.

Comma Conundrum

One of the most common questions I used to get way back in the old days was over using commas in the meta keywords tag. Consider these options:

Sigh. See why I hate this tag so much, when I’ve had to deal with people wondering about commas and spaces and variations like this. Let’s take it from the top, as to the motivations behind these versions:

This is someone who thinks that each word should be on its own, separated by a comma and with a space in front of the next word.

This is someone who thinks that getting rid of the spaces means they can squeeze in more words.

This is someone who thinks that if there are particular phrases they want to be found for, those phrases should be together and set off by commas.

As with three, but losing the spaces to squeeze in more words.

Similar to three but thinking you don’t need commas at all.

This is Mr. or Ms. Paranoid. They’re concerned about saying any word too often. So they lose the commas, restrict repetition and hope that proximity will help (IE, put “basset” behind “hound” rather than in front and maybe you’ll still show up for “basset hound.”

Which way should you go? I’d suggest number three, for these reasons:

Yahoo has long recommended using commas and in particular supported them as a way to separate out distinct terms for those in their paid inclusion programs. I’ll update this page with the latest advice, but commas still seem to make sense.

Spaces just make things look nicer, and you shouldn’t be shoving a ton of terms in the tag anyway. How long is too long? No idea! In the past, the search engines just wouldn’t index content beyond around 250 to 1,000 characters. Maybe I’ll test this in the future.

You do want phrases kept together. “bassett, hound” is probably going to be seen as “bassett hound” anyway, but why risk it?

Other Uses

I mentioned that misspellings were a key use for the tag. You could also use it for synonyms. For example, if you have a page all about shoes and you never say “footwear,” you could put that word in your tag. However, it’s far better if you just find a way to make use of the word in the body copy itself. That text is retrieved by all the major search engines, not just some.

Aside from synonyms, perhaps you have a page that’s all Flash or all images. Use the meta keywords tag to describe the page. Just remember that you’re still not likely to rank better than other pages that have textual information. Search engines are textual creatures. Give them what they want.

Some Official Guidelines

The W3C has guidelines (and here) in HTML 4.0 about meta data and search engines, while the XHTML specs don’t get into it at all. Ignore the specs. YES, IGNORE THE SPECS. Some of them are wrong; some are outdated. The only thing I can see that they explain is the difference between these:

<meta name=”keywords” content=”bassett”>

<meta name=”keywords” content=”bassett” />

See how the second tag ends /> rather than > in the first? As best I can tell, this is because a meta tag is an “empty element” in XHTML, where there’s not a “start” and a “finish” (as with a paragraph element: <p> is the beginning, with </p> the end). Empty elements in XHTML need that /> format.

I haven’t tested things without the />, but there are so many (so very, very many) pages out there not following that syntax that it is virtually certain Yahoo and Ask will read the tag either way. Doing it fresh? Do it /> style. But don’t go back and start changing things.

Aside from that, if you want to know how a search engine deals with meta data officially, you go to the search engine itself. Ask’s webmaster guidelines don’t mention the meta keywords tag, so that leaves Yahoo:

Yahoo Quality Guidelines: “Metadata (including title and description) that accurately describes the contents of a web page.” This is telling you don’t lie with your keywords. Don’t insert words that aren’t somehow related to the topic of your page.

How do I improve the ranking of my web site in the search results?: “Use a ‘keyword’ meta-tag to list key words for the document. Use a distinct list of keywords that relate to the specific page on your site instead of using one broad set of keywords for every page.” Note that it doesn’t say you’ll automatically rank better by doing this. Also, unique words for each page would be my advice, as well — but do NOT worry if you decide to use the same set of key terms on each of your pages. It isn’t that big of a deal.

Looking for the exact format that you should use for the meta keywords tag from Yahoo? You know, commas, spaces and all that. Sorry — they don’t provide it, which is another sign you’re probably worrying too much about it.

Freaked? Skip It

Overall, here’s the best advice I can offer anyone dealing with this tag. If you begin to feel confused, concern, tired or uncertain when pondering it, SKIP THE TAG ENTIRELY. It’s not going to hurt you to not have it, and it’s not worth the time fretting about it.

SMX Advanced is the only conference designed exclusively for experienced paid search advertisers and SEOs. You'll participate in experts-only sessions and network with fellow internet marketing thought leaders. Check out the tactic-packed agenda!

Sponsored

Everything you need to know about SEO, delivered every Thursday.

http://www.searchenginesservices.com seomama

Great article Danny! This is really great guidelines for most the SEO out there. This articles described about the usage of META Keywords in full details, i dont think the search engines guidelines would provide the cleary information as this. Appreciate it!!

tzd123

That was definitely a good one. Thanks Danny.

Arturo Ronchi

Nice article Danny.

One note about the tags; Google doesn’t use it to rank pages, no, but it will use it to differentiate pages. A change in meta keywords *can* help you to get pages out of the suplimental index.

http://www.agazillioncars.com Martin

Hi Danny,

I remembered reading that the Adsense bot used to read the meta keywords tag in order to display contextual ads, is it true?

http://www.pixelstreamed.com Shaze

Danny,
When you were talking about how Google doesn’t use the meta keywords tag I think you missed one very important situation in your research: Maybe Google’s spam filter is going off in it’s algorithm because the words in the meta keyword tags aren’t present in the actual body of the web page, so it completely ignores listing the page for those keywords. That being said there is probably no way to test this theory because one you input the keyword in your body and it shows up in the SERP’s it can be just because it was in the body of the page.
Secondly, maybe if the keyword appears in both the meta keyword tag and the body of the page it will get a boost in the algorithm SERP rankings rather than if it was just found on the page? No one will ever know I guess except the people that actually get to work on the actual code for the algorithms, so just to be safe maybe people should include it in their pages.

When it comes to SEO I think nothing should be left out, even if you could get a little boost from something as simple as a meta keyword tag I think it should be done. Just my thoughts.

http://htp://www.sitesell.com/ KenEvoy

Danny,

You know I love you, but I’ve got to disagree with much of what you say.

1) Your test for “qiskodslajdmnkd, ddakaieciuaj jkdalladpaoaw, wdaopeqndlkakljad” only proves that two engines don’t use it for SERP display if the keywords in a meta tag don’t appear on a page. Two do. Anything beyond that is conjecture as to cause-and-effect. This test was way too simplistic to prove anything more than that.

2) I disagree with the conclusion (put a mis-spelling in the meta keyword tag so that it ranks). A common mis-spelling is not the same as an extreme nonsense word. More importantly, to do anything PURELY for the engines, in the long-run, is likely a mistake. If you are ashamed to show it to humans, don’t show it to the engines.

3) Your conclusions re its importance (or lack of same) for ranking is also flawed. The algorithms are far too complex to make such simplistic assertions and conclusions.

4) As to commas, it’s pretty comma-sense really (sorry, couldn’t resist). Commas are not a reason to stress over it and “hate” the tag. And it’s an “issue” with all tagging systems. It’s just that no one has laid out the rules clearly since the engines don’t want to be transparent on their algorithms, nor do I blame them. But in the end, it’s really comma-sense and your recommendations are spot-on.

5) As to official search engine guidelines, what they DO say has some value. What they do NOT say would have more value if we knew it (which, of course, we don’t and that’s the point isn’t it?). Yahoo!’s official guidelines used to categorically state they use it. Now they don’t but they talk about metadata? How to interpret that? Don’t even try.

6) Danny, I could not disagree with your conclusion more. It costs nothing to include meta keyword tags, at least not when done properly (using a few words at most, comma-separated).

In a Web 2.0 world that has become tag-obsessed, it’s ironic that the useful old Meta keyword tag is so widely dissed.

Long may it live. It’s a handy way to let engines know the most important topics of any page. If you abuse the tag, here’s what I would do if I were a Search Engine — I’d ignore it. If you use it properly, I’d take note. Easy to tell the difference? After 10 years, sure. Beyond that, what each engine really does with it none of us know.

If I were an engine, I’d take note of tag that exists specifically to tell me what the important topics of the page are. Wouldn’t you? And if YOU wouldn’t, no loss to including it — so many people do that there cannot possibly be a penalty except for those who stuff it.

No downside. Possible minor (at this stage, any single element is minor but this is more so, I agree) gain.

Use it, I say.

All the best,
Ken Evoy
President, SiteSell.com

MattC

Fantastic article Danny. I would have never spent more than 2 minutes of my own time writing about the Meta Keywords Tag. Applause.

http://www.dotcult.com Ryan

Great post Danny.

I wish you’d do a post about paid inclusion programs as well. I have so many clients who buy into the rep hype that I’d love to have something authoritative to point them to.

1) The test shows that Google and Yahoo will not recover a page if the word you searched for only appears within the meta keywords area. If they did, you’d have seen my home page coming up. If the argument is they retrieve the page but then say oh, the word is only in the meta keywords tag so don’t show it, same thing in the end. The page isn’t turning up.

2) My recommendation is don’t bother with the tag. But if you really want to, then misspellings to me are fine. That been a long-standing use of the meta keywords tag, so you’re on solid ground in my book.

3) It’s a simplistic test because that’s all it needs to be. It was designed to see if a search engine would find a page if the word you looked for only appeared in the meta keywords tag. Two do; two don’t. It’s not a ranking test, so a simple yes/no answer is absolutely fine.

6) It costs time. Too many beginners spend way too much time on the tag rather than their content. That’s a serious cost, hence my conclusion :)

As for taking note, if I were a search engine, I’d ignore the tag because of the widespread misuse. I’d rely more on other factors — which is what they in fact do.

http://www.oldschoolseo.com oldschoolseo

Danny, there is another school of thought that dates way back to SES NYC 2000 and that was by using a comma and a space, a search bot would recognize that as a “double parse” where the comma serves as one and the space serves as the other. This is my understanding of the history of the “comma, no space” format.

Cheers!

- Anthony

http://www.antezeta.com/blog/ Sean Carlos

Well done. Thank you.

One other use of keyword values might be to assist in defaulting social bookmark “tags” for users who bookmark a page. The keywords can be passed on to many social media sites with the help of a bit of JavaScript.

It might be worth specifically noting that the TITLE tag, which appears along with the meta tags in the html HEAD document section, is simply the document title, not the “title meta tag” I often hear it called.

Unlike the meta tags, it is visible. The graphical browsers include it at the top of the browser window. They also use it as a page’s bookmark title. The terminal based browser Lynx displays the TITLE at the top of the page.

As for closing meta tags with />, this is indeed an xml requirement for sites which have specified xhtml as the html version in the DOCTYPE statement at the top of a page. Other common tags which need this closure include IMG, BR and HR.

http://www.benjarriola.com Benj Arriola

I work with a company that is soooo anal on these tags. Before I came in I never put any serious attention on the Meta Keywords tag after just playing around in SEO contest and looking at what other people are doing already gave me the idea the tags is nearly useless. Now here I go corporate SEO work, on my first few days, I kept redoing meta keywords tag. But still I don’t mind doing them to be inline with the company’s policies and making sure everything is done the same way as everyone else but on my own SEO work, I just place almost anything in the Meta Keywords tag. Just related words that come into my head without using any keyword research tools.

bood guy

A very simple algorithm that would give back the value of the keyword meta tag:

1. Check this ratio: (number of meta keywords) / (number of words in the visible copy)

2. If the ratio is below a certain threshold, give the keywords a certain weight (because a small ratio proves that this meta tag is probably used sensibly).

3. If it is above that threshold, but still smaller than a second, higher threshold, give less weight to the keywords.

4. It this ratio is above the second threshold (so the meta tag is overstuffed with keywords relative to the amount of copy), give the keywords no weight.

Myron Rosmarin

Great article Danny, thanks so much for writing it.

http://www.netrafic.com RayPays

Danny,
We continue to use the keyword tag just to keep us on topic when writing for the page. And yes, we’ve been arguing about commas versus no commas for a decade. I am in the no comma camp because if the robots read and/or ever use the tag we believe it allows them to form whatever “terms” they want to out of the word jumble – over, under, sideways, down !

Now, about this whole meta keywords issue. If Yahoo uses it, and there’s a possibility that Google does in some ways, or even if only Yahoo does, and maybe some lesser search engines, then for the lousy few moments it takes to fill the field, why wouldn’t I take that time?

Sure, it’s not on my top five SEO list. But neither are twenty or thirty other things I do.

But if using it helps even a bit, then personally, I feel it’s worth it.

Just as valuable to me is the fact that it’s a nifty little consistently located place for me to keep the words and phrases that I want to have there as a reminder for my clients and my team to refer to when they’re working on the content of a page. Can’t remember which words and phrases you need to build your natural language site content around? Simple – refer to the meta keywords field!

Anyway, I love the fact that these issues are so debatable – the more we discuss and debate them within the industry, the more we hone our skills. And for me, I’m always needing to do that. How else am I ever going to eventually become the SEO demi-god I’ve made myself out to be in my own mind?