clasione
06-04-2005, 02:02 AM
WEBPRONEWS ARTICLE,
Recently, Google launched Sitemaps (https://www.google.com/webmasters/sitemaps/login), a "collaborative crawling" service designed to keep Google informed of modifications to your web site so their search index can reflect these changes… or as Rusty call it (http://www.seroundtable.com/archives/002034.html), a free pay-for-inclusion program.
Sitemaps works by taking advantage of XML and RSS capabilities. By placing XML code on the web server, you inform Google of when changes occur, and they respond by crawling the updated pages and making the necessary updates to the search index. Over at the Google Blog (http://googleblog.blogspot.com/2005/06/webmaster-friendly.html), Engineering Director Shiva Shivakumar indicated why Google launched Sitemaps:
"Initially, we plan to use the URL information webmasters supply to further improve the coverage and freshness of our index. Over time that will lead to our doing an even better job of delivering more search results from more websites."
Shiva also gave an extensive interview to Danny Sullivan over at the SearchEngineWatch Blog (http://blog.searchenginewatch.com/blog/050602-195224). In it, Shiva iterates that the Sitemaps program's current beta state; he won't guarantee each submitted URL would be crawled. He did indicate that this was something they were working toward, however.
As mentioned, in order to participate in Sitemaps, you have to have a Google account and you have to place an XML file on the webserver being used by your site. This is done in order to inform Google's crawlers of what URLs to look for and how often these pages change. As pointed out by Rusty, over at SocialPatterns.com (http://www.socialpatterns.com/search-engine-optimization/breaking-down-google-sitemaps-xml/), SEM Michael Nguyen broke down an example of his Sitemaps' XML code, line-by-line; in order to shed some light on what's actually being done.
The XML file must also the URL of each page you want to be in the Sitemaps program. If you have four pages that undergo frequent change, all 4 page URLs should be listed, if you have an entire site that you want included, you have to include the URL of each page. By employing the changefreq and priority XML tags, you can also indicate how important each page is and how frequently the page changes.
After the XML is complete, you must submit it to the Sitemaps program. This is where the Google account comes in. Once the URL of the sitemap is submitted, your task is complete.
There are a couple of methods you can use in order to get an XML sitemap. A sitemap generator (https://www.google.com/webmasters/sitemaps/docs/en/sitemap-generator.html) can be downloaded from Google or you can develop one. The generator is an open-source Python file that has to be uploaded to the webserver. According to their FAQ the sitemap generator "can create sitemaps from URL lists, webserver directories, or from access logs."
You can also develop your own XML sitemap (https://www.google.com/webmasters/sitemaps/docs/en/protocol.html) if you so choose. This will have to be submitted as well. The final method Google accepts is a text file containing the URLs you want in the program. Obviously, this method is saved for those who have little experience dealing with webservers or structural web alterations. It also seems like the text files will be given the lowest priority, at least until the program is off and running.
As to whether or not you should be taking part in the Google Sitemaps program is quite simple: if search engines play any role in your business whatsoever, you should be apart of the program. Having Google's (or any other search engine for that matter) index reflect changes in your site quickly will only benefit your search engine presence. Or as Nathan Weinberg (http://google.blognewschannel.com/index.php/archives/2005/06/02/google-begins-website-update-reporting-service/) says, it'd be stupid not too.
An additional area of interest is that Google made Sitemaps as open-source as possible… at least on the XML end. By making the sitemap generator in Python and releasing it under the Attribution/Share Alike Creative Commons license (http://creativecommons.org/licenses/by-sa/2.0/), Google is only furthering their embrace of open-source. This also allows the program to be adapted in order to support other search engines.
Update: Someone who emailed (http://www.incendiary.ws/node/94) me installed the sitemap generator on his webserver, and evidently the server went boom... or it at least was overtaxed. Here's a quote from his post discussing the event: "Running it brought down my 3200MHz Pentium 4 running Debian Linux and 2 GB of RAM."
Read Theo's report (http://www.incendiary.ws/node/94) and see for yourselves.
About the Author:
Chris Richardson is a search engine writer for WebProNews (http://www.webpronews.com/). Visit WebProNews for the latest search news (http://www.webpronews.com/).
_______________________________________
I'm not overly exited about this site progeram just yet. Although it is great to be able to attract Google or any other search engine on a frequent basis, if your site is strong enough and updated enough the search engines will be back to crawl it whether or not you are using the Google sitemap program.
I'm more concerned at what benefits this program serves to Google and exactly why they are launching it when they have so much other things going on...
The only thing I could see happening by participating in this program, is that Google will now know for sure exactly which website is concerned with search engine rankings and which simply don't care....
hmm, that could be worth more to them than knowing they have YOUR most recent data in there index....
It's not something I will do anytime soon. My job is getting that crawler to my site daily regardless becasue my site and content warrent it.
It could be something I move to in the future, but for now, I don't immediatly see the benefit.
Recently, Google launched Sitemaps (https://www.google.com/webmasters/sitemaps/login), a "collaborative crawling" service designed to keep Google informed of modifications to your web site so their search index can reflect these changes… or as Rusty call it (http://www.seroundtable.com/archives/002034.html), a free pay-for-inclusion program.
Sitemaps works by taking advantage of XML and RSS capabilities. By placing XML code on the web server, you inform Google of when changes occur, and they respond by crawling the updated pages and making the necessary updates to the search index. Over at the Google Blog (http://googleblog.blogspot.com/2005/06/webmaster-friendly.html), Engineering Director Shiva Shivakumar indicated why Google launched Sitemaps:
"Initially, we plan to use the URL information webmasters supply to further improve the coverage and freshness of our index. Over time that will lead to our doing an even better job of delivering more search results from more websites."
Shiva also gave an extensive interview to Danny Sullivan over at the SearchEngineWatch Blog (http://blog.searchenginewatch.com/blog/050602-195224). In it, Shiva iterates that the Sitemaps program's current beta state; he won't guarantee each submitted URL would be crawled. He did indicate that this was something they were working toward, however.
As mentioned, in order to participate in Sitemaps, you have to have a Google account and you have to place an XML file on the webserver being used by your site. This is done in order to inform Google's crawlers of what URLs to look for and how often these pages change. As pointed out by Rusty, over at SocialPatterns.com (http://www.socialpatterns.com/search-engine-optimization/breaking-down-google-sitemaps-xml/), SEM Michael Nguyen broke down an example of his Sitemaps' XML code, line-by-line; in order to shed some light on what's actually being done.
The XML file must also the URL of each page you want to be in the Sitemaps program. If you have four pages that undergo frequent change, all 4 page URLs should be listed, if you have an entire site that you want included, you have to include the URL of each page. By employing the changefreq and priority XML tags, you can also indicate how important each page is and how frequently the page changes.
After the XML is complete, you must submit it to the Sitemaps program. This is where the Google account comes in. Once the URL of the sitemap is submitted, your task is complete.
There are a couple of methods you can use in order to get an XML sitemap. A sitemap generator (https://www.google.com/webmasters/sitemaps/docs/en/sitemap-generator.html) can be downloaded from Google or you can develop one. The generator is an open-source Python file that has to be uploaded to the webserver. According to their FAQ the sitemap generator "can create sitemaps from URL lists, webserver directories, or from access logs."
You can also develop your own XML sitemap (https://www.google.com/webmasters/sitemaps/docs/en/protocol.html) if you so choose. This will have to be submitted as well. The final method Google accepts is a text file containing the URLs you want in the program. Obviously, this method is saved for those who have little experience dealing with webservers or structural web alterations. It also seems like the text files will be given the lowest priority, at least until the program is off and running.
As to whether or not you should be taking part in the Google Sitemaps program is quite simple: if search engines play any role in your business whatsoever, you should be apart of the program. Having Google's (or any other search engine for that matter) index reflect changes in your site quickly will only benefit your search engine presence. Or as Nathan Weinberg (http://google.blognewschannel.com/index.php/archives/2005/06/02/google-begins-website-update-reporting-service/) says, it'd be stupid not too.
An additional area of interest is that Google made Sitemaps as open-source as possible… at least on the XML end. By making the sitemap generator in Python and releasing it under the Attribution/Share Alike Creative Commons license (http://creativecommons.org/licenses/by-sa/2.0/), Google is only furthering their embrace of open-source. This also allows the program to be adapted in order to support other search engines.
Update: Someone who emailed (http://www.incendiary.ws/node/94) me installed the sitemap generator on his webserver, and evidently the server went boom... or it at least was overtaxed. Here's a quote from his post discussing the event: "Running it brought down my 3200MHz Pentium 4 running Debian Linux and 2 GB of RAM."
Read Theo's report (http://www.incendiary.ws/node/94) and see for yourselves.
About the Author:
Chris Richardson is a search engine writer for WebProNews (http://www.webpronews.com/). Visit WebProNews for the latest search news (http://www.webpronews.com/).
_______________________________________
I'm not overly exited about this site progeram just yet. Although it is great to be able to attract Google or any other search engine on a frequent basis, if your site is strong enough and updated enough the search engines will be back to crawl it whether or not you are using the Google sitemap program.
I'm more concerned at what benefits this program serves to Google and exactly why they are launching it when they have so much other things going on...
The only thing I could see happening by participating in this program, is that Google will now know for sure exactly which website is concerned with search engine rankings and which simply don't care....
hmm, that could be worth more to them than knowing they have YOUR most recent data in there index....
It's not something I will do anytime soon. My job is getting that crawler to my site daily regardless becasue my site and content warrent it.
It could be something I move to in the future, but for now, I don't immediatly see the benefit.