• 1 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Why the robots.txt file is important ??
#11
A robots.txt file gives instructions to web robots about the pages the website owner doesn’t wish to be ‘crawled’. For instance, if you didn’t want your images to be listed by Google and other search engines, you’d block them using your robots.txt file.
Reply
#12
Your site is simple and error free and you want everything indexed, If you want to block some pages and delete website URL.

Then you need a robots.txt file.
Reply


Possibly Related Threads...
Thread Author Replies Views Last Post
  How important are longtail keywords? mvminfotechseo 4 41 10-11-2018, 12:24 AM
Last Post: RH-Calvin
  What Is Link Building & Why Is It Important? mvminfotechseo 2 84 10-08-2018, 03:55 AM
Last Post: sankalppatil
  Why backlink is very important for SEO? canadaimmigrationconsultant 14 297 10-04-2018, 11:39 PM
Last Post: TangelThor
  Why SEO is Important for new websites..? ninadordev 11 133 10-04-2018, 12:31 AM
Last Post: TangelThor
  Which is the most important thing for ranking on search engines? ninadordev 5 110 09-26-2018, 07:32 PM
Last Post: keshacarey
  Which Important Factors Makes On Page Optimization Better ? swatijain2233 6 70 09-26-2018, 07:26 PM
Last Post: keshacarey
  Give some important guest blogging sites? vishwa01 7 262 09-10-2018, 11:26 PM
Last Post: RH-Calvin
  Which Is More Important – Bounce Rate Or Exit Rate? ninadordev 11 200 09-10-2018, 04:01 AM
Last Post: vicky
  Why is SEO so important? ZoyaBhatt 17 717 09-10-2018, 01:29 AM
Last Post: sonamg
  Export EDB File To PST carollien 2 86 09-04-2018, 02:55 AM
Last Post: hunzila

Digg   Delicious   Reddit   Facebook   Twitter   StumbleUpon  


Users browsing this thread:
1 Guest(s)


Webmasterbabble.com, © 2012-2018 .