Knowledgebase: SEO, Facebook, Ads
Working with Robots
Posted by Viktor Klymonchuk, Last modified by Viktor Klymonchuk on 10 December 2010 06:17 PM
Quick and easy.
http://tool.motoricerca.info/robots-checker.phtml

Як створювати robots.txt. - поради від Google
http://www.google.com/support/webmasters/bin/answer.py?answer=40360&ctx=sibling

Ще пару цікавих порад від Google
http://www.google.com/support/webmasters/bin/topic.py?topic=8475

AKA Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable.
http://en.wikipedia.org/wiki/Robots.txt


(6 vote(s))
Helpful
Not helpful

Comments (0)
Managed by WebCTO