Technical SEO Wiki Entry
Meta Robots Tag
An HTML meta tag controlling crawler indexing and link-following behaviour.
Meta robots accepts directives like index/noindex, follow/nofollow, noarchive, nosnippet, noimageindex and max-snippet. Multiple directives can be combined comma-separated. Different bots can be targeted using name="googlebot" or "bingbot". The same directives can be applied site-wide via X-Robots-Tag HTTP headers, useful for non-HTML resources like PDFs.
Want to apply this in practice?
The Complete Wix SEO Course covers this topic and 67 others in step-by-step lessons designed for real Wix sites.
Explore the course
Translate