SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO
FREE Website Submission
https://www.pingmylinks.com

Join the forum, it's quick and easy

SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO
FREE Website Submission
https://www.pingmylinks.com
SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO
Would you like to react to this message? Create an account in a few clicks or log in to continue.
SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO

Free Ad Forum - Post a FREE Ad - Business - SEO - Search Engine Optimization


Can I use robots.txt to optimize Googlebot's crawl?

SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO :: SEARCH ENGINES :: Google

Go down

Can I use robots.txt to optimize Googlebot's crawl? Empty Can I use robots.txt to optimize Googlebot's crawl?

Post by NewsOnline Thu Aug 19, 2010 3:14 am

Can I use robots.txt to optimize Googlebot's crawl?

Can I use robots.txt to optimize Googlebot's crawl? For example, can I disallow all but one section of a site (for a week) to ensure it is crawled, and then revert to a 'normal' robots.txt?

NewsOnline
NewsOnline

Posts : 853
Points : 7346
Reputation : 0
Join date : 2010-08-12

http://forum.seoflexforum.com

Back to top Go down

Back to top

- Similar topics

SeoflexForum - Free Ad Forum - Post a FREE Ad - Business - SEO :: SEARCH ENGINES :: Google

 
Permissions in this forum:
You cannot reply to topics in this forum