Creating and submitting sitemaps
You can speed up the indexing of your site and have more chance of geting all of your pages crawled and indexed by the search engine spiders if you give them a properly constructed site map to feed on - that way you know they can get to all the pages of your site directly rather than just jumping around links as they find them.
Google sitemap
If you produce a valid XML sitemap in the format required by Google you can submit it using their Webmaster Tools facility.
Yahoo sitemap
Yahoo has a similar thing called Site Explorer but it needs a text formal list of all the urls on your site.
HTML sitemap
Create an HTML format sitemap listing the titles of all your site pages so that human visiotrs can easily see the structure and content of the site. If you call it sitemap.html and put a prominent link to it high on your index page you may get spiders from other search engines to follow it as well.
Automating the process
You can produce these different formats of sitemap manually, but it is a messy process and you have to keep updating them every time you create a new page and also updating and re-submitting them when content changes.
We use an automated php script to do the work and then run a cron job on our hosting server to run a new crawl and ping google once a week so we are always re-submitting fresh content
(of course you do need to keep your site content fresh).
You can use a free version of the software we use or buy the paid version (which is great and you can install it on as many web domains as you like) for less than $20.00 here
 |
|
Search our site or the web with Google
