skip to main | skip to sidebar

How to Build a Website

This website provides guidance in building your own website and aims to share some of the lessons I've learned over the last few years. It is written with my friends Steve and Ange Cocker in mind, to help them build an important website but I hope others might find it useful too. They are smart cookies so this will not be a dummies guide.

This modest effort was inspired by Fergus Cocker.

Sunday, January 20, 2008

Add a robots.txt page to tell search engines like google which pages to leave out of the index

There is a good summary of the robots.txt file here: The Web Robots Pages.

These days, you can add a reference to the location of your sitemap here too.
Posted by litsl at 4:10 PM

No comments:

Post a Comment

Newer Post Older Post Home
Subscribe to: Post Comments (Atom)

About Me

My photo
litsl
View my complete profile

Links

  • Home
  • www.litsl.com (my website)

Blog Archive

  • ►  2010 (2)
    • ►  July (1)
    • ►  May (1)
  • ►  2009 (3)
    • ►  July (1)
    • ►  April (1)
    • ►  February (1)
  • ▼  2008 (14)
    • ►  September (1)
    • ►  August (2)
    • ►  May (1)
    • ►  April (1)
    • ►  March (1)
    • ►  February (2)
    • ▼  January (6)
      • Telling Google WHERE you are in the world
      • Web Page Title Tags for Search Engine Optimization...
      • Google Webmaster Tools
      • Add a robots.txt page to tell search engines like ...
      • Adding a Sitemap
      • base href does not work for php includes !! (and w...
  • ►  2007 (10)
    • ►  December (2)
    • ►  November (6)
    • ►  February (1)
    • ►  January (1)
  • ►  2006 (12)
    • ►  December (2)
    • ►  November (1)
    • ►  March (1)
    • ►  February (8)