游客

标题:该怎么写magento的robots.txt文件
正文:
如果是懂SEO的人都知道robots.txt文件的重要性。但是如果什么不知道robots.txt的重要性，正确建立robots.txt 文件的内容可有效的优化magento网站，防止垃圾链接网址被搜索引擎纳入索引，降低网站的权重。 该怎么去建一个robots.txt呢？ # Website SitemapSitemap: http://www.mydomain.com/sitemap.xml # Crawlers SetupUser-agent: *Crawl-delay: 10 # Allowable IndexAllow: /*?p=Allow: /catalog/seo_sitemap/category/Allow:/catalogsearch/result/ # DirectoriesDisallow: /404/Disallow: /app/Disallow: /cgi-bin/Disallow: /downloader/Disallow: /includes/Disallow: /js/Disallow: /lib/Disallow: /magento/Disallow: /media/Disallow: /pkginfo/Disallow: /report/Disallow: /skin/Disallow: /stats/Disallow: /var/ # Paths (clean URLs)Disallow: /index.php/ Disallow: /catalog/product_compare/Disallow: /catalog/category/view/Disallow: /catalog/product/view/Disallow: /catalogsearch/Disallow: /checkout/Disallow: /control/Disallow: /contacts/Disallow: /customer/Disallow: /customize/Disallow: /newsletter/Disallow: /poll/Disallow: /review/Disallow:
[<<][[1]][2][>>]

查看评论(0)
发表评论



首页