Robots.txt 的用途与介绍 (Introduction to robot.txt)
|
A robots.txt file lets you specify the robots (also known as "bots" or "spiders") you want to block from crawling files or directories on your site
|
功用: 禁止网页机器人(Web Robots) 爬取你网站的目录或资料夹 。Web Robots 又称为 "bots", "spiders", "crawlers", "wanderers"
参考:
Improving on Robots Exclusion Protocol
Manually creating a robots.txt file
( 0 Votes )
视频需要时间下载 ,冲杯咖啡回来再看也不慢 ^_^
Joomla! The best friend of all!
欢迎大家利用下方的评论系统提出您对此视频的意见或评论 ,尚若您在测试或使用以上所介绍的套件时遇到了疑难 ,则请到各大论坛询问 ,勿张贴于此 ,谢谢合作。




评论