robots.txt,SEO优化,安全
User-agent: *
Disallow: /App_Code/
Disallow: /App_Data/
Disallow: /App_Themes/
Disallow: /bin/
Disallow: /cgi-bin/
Disallow: /bbs/badm/
Disallow: /doc/dadm/
Disallow: /ext/
Disallow: /inc/
Disallow: /member/
Disallow: /pfile/
Disallow: /sadm/
Disallow: /setup/
Disallow: /smod/
Disallow: /tools/
Disallow: /trade/madm/
Disallow: /trade/mpub/
Disallow: /upfile/sys/
Disallow: /images/
Disallow: /page/images/
Disallow: .txt$
Disallow: .doc$
Disallow: .xls$
Disallow: .config$
Sitemap: http://www.my~domain.com/ext/seo/sitemap.xml
禁止收录,禁止快照
<meta name="robots" content="noindex, nofollow">
<meta name="robots" content="noarchive">
禁止收录,禁止快照