Skip to main content

An SEO’s Guide to Using Robots Exclusion Protocol



How to use Robots.txt rules including wildcards, the X-Robots-Tag and noindex indexing directives to keep your content out of Google. Occasionally, we all find an item of content that has been indexed by a search engine that we don’t want other people to find.

http://bit.ly/2UQLmvX
via An SEO’s Guide to Using Robots Exclusion Protocol

Comments

Post a Comment

Popular posts from this blog

Programmatic advertising 101 (Infographic)

While advertising typically relies on broadcasting messages to a mass audience, recent technologies have enabled advertisers to reach exactly the people they want. And brands have rushed to snap up these online options. https://ift.tt/2XbX9GW via Programmatic advertising 101 (Infographic)
Post a Comment
Read more

What I Learned About Life at My 30th College Reunion

On the weekend before the opening gavel of what’s being dubbed the Harvard affirmative-action trial, a record-breaking 597 of my fellow members of the class of ’88 and I, along with alumni from other reunion classes, were seated in a large lecture hall, listening to the new president of Har https://ift.tt/2CzFQId via What I Learned About Life at My 30th College Reunion
Post a Comment
Read more

The myth of British humour and resilience, born in World War II, is about to die a Brexit death

Since the 2016 EU referendum, Britain’s reputation in European centres of power has undoubtedly suffered. https://ift.tt/2I54VgZ via The myth of British humour and resilience, born in World War II, is about to die a Brexit death
Post a Comment
Read more