Skip to main content

An SEO’s Guide to Using Robots Exclusion Protocol



How to use Robots.txt rules including wildcards, the X-Robots-Tag and noindex indexing directives to keep your content out of Google. Occasionally, we all find an item of content that has been indexed by a search engine that we don’t want other people to find.

http://bit.ly/2UQLmvX
via An SEO’s Guide to Using Robots Exclusion Protocol

Comments

Post a Comment

Popular posts from this blog

Programmatic advertising 101 (Infographic)

While advertising typically relies on broadcasting messages to a mass audience, recent technologies have enabled advertisers to reach exactly the people they want. And brands have rushed to snap up these online options. https://ift.tt/2XbX9GW via Programmatic advertising 101 (Infographic)
Post a Comment
Read more

The myth of British humour and resilience, born in World War II, is about to die a Brexit death

Since the 2016 EU referendum, Britain’s reputation in European centres of power has undoubtedly suffered. https://ift.tt/2I54VgZ via The myth of British humour and resilience, born in World War II, is about to die a Brexit death
Post a Comment
Read more

The hunt for human nature

The Austrian zoologist Konrad Lorenz embodied the ideal of a white-maned sage. Acclaimed by readers in German and English alike for his books King Solomon’s Ring (1949) and Man Meets Dog (1949), he enjoyed worldwide renown as an expert on the behaviour of fowl, fish and beast. https://ift.tt/2PMldQ1 via The hunt for human nature
Post a Comment
Read more