Purpose of Custom Robots
Header Tags

Now
you are going to meet with the following custom robots header tags.

all – This tag allow you, crawlers are not
bound by any restrictions. They can freely crawl, index and expose your
content.

noindex
– Not every one of the blogs are for open notice. Regardless of the possibility
that you don't share the URL of your own blog with anyone, odds are individuals
will come to it from indexed lists. On such a situation, you can utilize
noindex tag as it keeps web crawlers from ordering the pages.

nofollow
– Nofollow and dofollow labels are for outbound connections. Dofollow is the
default robot tag for all your outbound connections. That implies the web
indexes can sneak upon the pages you connected to. On the off chance that you
don't need seek bots to look through your connections, expansion of a nofollow
tag must help you.

none
– none joins the components of both noindex and nofollow labels. The crawlers
will neither record your pages nor skim through the connections.

noarchive
– You may have seen a stored mark with a large portion of the site connects on
SERPs. It demonstrates that Google has caught a duplicate of your site into
their server to show in the event that it goes down. That being said, the
noarchive label kills stored form in pursuit pages.

nosnippet
– The content pieces in query items individuals discover what's on the website
page. In the event that you need to keep the substance selective, you can turn
this header tag on.

noodp
– Open Directory Project or Dmoz is a man-made catalog of sites. Google utilize
the data from that point some of the time. You can turn it off with this tag on
the off chance that you need to.

notranslate
– Do you need to handicap interpretation on your site? At that point utilize
notranslate for the correct reason.

noimageindex
– If you permit Google to list your pictures, individuals may take it and use
all alone sites. To keep that, you can keep the pictures deindexed utilizing
noimageindex tag. Likewise Read this Image SEO manage.

unavailable_after
– In Blogger, you will get a field ideal to this tag. Along these lines, the
website page will be deindexed after this time.

How to Setup Custom Robots
Header Tags?

There
you can see a setting called Custom robots header tags under Crawlers and
Indexing. Click the Edit link to the right of it.

Step
2: At this step, you will notice two radio buttons. Obviously, the first one
should be your pick.

Step
3: Now, you will get a set of checkboxes. It may feel like a problematic one,
but it’s easy. Just follow the same settings I chose (refer to the image given
below) and hit Save changes. That’s all.