{"id":4896,"date":"2020-09-24T15:59:21","date_gmt":"2020-09-24T14:59:21","guid":{"rendered":"https:\/\/www.20i.com\/blog\/?p=4896"},"modified":"2025-01-15T12:49:27","modified_gmt":"2025-01-15T12:49:27","slug":"sitemaps-complete-guide","status":"publish","type":"post","link":"https:\/\/www.20i.com\/blog\/sitemaps-complete-guide\/","title":{"rendered":"What is a sitemap? A guide"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>A sitemap is a roadmap to your website. It gives search engines and users easy access to its key pages and content. <\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">They can be vital when it comes to SEO success, but how exactly do they work? Why do you need one, and how do you go about creating one for your site?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Our ultimate guide to sitemaps answers all of these questions and more. You\u2019ll find the following topics covered below:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"#What-is-a-sitemap\">What is a sitemap?<\/a><\/li>\n\n\n\n<li><a href=\"#What-are-sitemaps-used-for\">What are they used for?<\/a><\/li>\n\n\n\n<li><a href=\"#Do-I-need-one\">Do I need one?<\/a><\/li>\n\n\n\n<li><a href=\"#history-sitemaps\">When were they introduced?<\/a><\/li>\n\n\n\n<li><a href=\"#anatomy-sitemaps\">Sitemap anatomy<\/a><\/li>\n\n\n\n<li><a href=\"#sitemap-types\">What different types of sitemap are there?<\/a><\/li>\n\n\n\n<li><a href=\"#create-sitemap\">Creating a sitemap<\/a><\/li>\n\n\n\n<li><a href=\"#submit-sitemap\">How to submit it to Google<\/a><\/li>\n\n\n\n<li><a href=\"#test-sitemap\">How to test a sitemap<\/a><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"What-is-a-sitemap\">What is a sitemap?<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">A sitemap is a complete map of your website that allows search engines and visitors to find their way around its pages and content. They can broadly be divided into two types: XML sitemaps and HTML sitemaps.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An XML sitemap is basically a file that stores information about the pages, videos and other content on your site as well as the relationship between them. All of this is based on the data you add to the file yourself.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">When there\u2019s an XML sitemap in place, search engines can <a href=\"https:\/\/support.google.com\/webmasters\/answer\/156184?hl=en\" rel=\"nofollow\">crawl a website more intelligently<\/a>, learning valuable information about it along the way. This includes when it was most recently updated, how often its content is refreshed and whether alternate language versions of the site are available.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">HTML sitemaps, meanwhile, are visual tables of contents aimed at site visitors, rather than search engines. Their main purpose is to help users navigate your website, but they can have SEO benefits, too.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From here on in, this guide mainly focuses on XML sitemaps.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/about-sitemaps.png\" alt=\"a real map\" class=\"wp-image-4919\" srcset=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/about-sitemaps.png 600w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/about-sitemaps-300x200.png.webp 300w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/about-sitemaps-370x247.png.webp 370w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/about-sitemaps-270x180.png.webp 270w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"What-are-sitemaps-used-for\">What are sitemaps used for?&nbsp;<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">They allow webmasters to signpost the most important pages and content on their website and relay this information to search engines. This gives Google and its competitors a clearer idea of your site\u2019s structure and insight into the nature of the content it hosts.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This includes fine details about the video, image and other media files on your website. For instance, a sitemap video entry can tell Google how long the clip runs for, what category it belongs-to and whether there\u2019s an age-appropriateness rating for users to be aware of. An image entry, meanwhile, can shed light on its subject matter, file type and usage rights.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Giving this key information to search engines to help them better understand the context of your website and how to categorise it. This can give your site an SEO boost.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Do-I-need-one\">Do I need one?&nbsp;<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Sitemaps can be useful if your site is particularly large. Like if it has an archive of pages that aren\u2019t linked well, or contains a vast amount of media files. That said, Google themselves have confirmed that \u201ca sitemap can improve the crawling of your site\u201d in most cases.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There are some situations where a sitemap is more important that others. But the majority of websites would benefit from having one, and you\u2019ll <a rel=\"nofollow\" href=\"https:\/\/yoast.com\/the-sense-and-nonsense-of-xml-sitemaps\/\">never be penalised for it<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"history-sitemaps\">When were sitemaps introduced?<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Google introduced sitemaps back in the summer of 2005 to help web developers make their sites more crawler-friendly by publishing a comprehensive list of links. The web giant <a rel=\"nofollow\" href=\"https:\/\/googlepress.blogspot.com\/2006\/11\/major-search-engines-unite-to-support_16.html\">launched a joint initiative<\/a> with Yahoo and Microsoft the following year to support Sitemap 0.90 &#8211; the next schema version of the web tech.  They encouraged its widespread adoption.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By April of 2007, Ask.com and IBM had added their names to the list of sitemap supporters, while Google, Yahoo and MSN added auto-discovery for sitemaps to their search engines. With Google\u2019s help, the state governments of Arizona, California, Utah and Virginia were among the first major organisations to add sitemaps to their websites later that year.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In 2020, there was another milestone in the rollout and widespread usage of sitemaps. Thanks to a collaboration between developers at Google and Yoast, XML sitemaps were added to the core of market-leading content management platform WordPress.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A bespoke plugin entered testing in late January before the feature was <a rel=\"nofollow\" href=\"https:\/\/wptavern.com\/wordpress-5-5-to-include-extensible-core-sitemaps#:~:text=One%20year%20ago%20developers%20at,for%20inclusion%20in%20WordPress%205.5.\">rolled out as part of the WordPress 5.5 update<\/a>, allowing users to add native Google sitemap integration directly from their content management systems.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/sitemap-anatomy.png\" alt=\"map with binoculars\" class=\"wp-image-4918\" srcset=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/sitemap-anatomy.png 600w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/sitemap-anatomy-300x200.png.webp 300w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/sitemap-anatomy-370x247.png.webp 370w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/sitemap-anatomy-270x180.png.webp 270w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"anatomy-sitemaps\">The anatomy of sitemaps<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Below, you can see what the raw code for a standard XML sitemap entry looks like:<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>&lt;url&gt;\n&lt;loc&gt;http:\/\/www.hypothetical.com\/webpage&lt;\/loc&gt;\n&lt;lastmod&gt;2020-09-09&lt;\/lastmod&gt;\n&lt;changefreq&gt;monthly&lt;\/changefreq&gt;\n&lt;priority&gt;1&lt;\/priority&gt;\n&lt;\/url&gt;<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">The code above relays key information to search engines:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li> where this page is located (loc)<\/li>\n\n\n\n<li>when it was last updated (lastmod)<\/li>\n\n\n\n<li>how often its content is likely to change (changefreq)<\/li>\n\n\n\n<li>how important it is in the context of the website (priority)<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Changefreq and priority, in particular, <a href=\"https:\/\/www.v9digital.com\/insights\/sitemap-xml-why-changefreq-priority-are-important\/\" rel=\"nofollow\">are important tags<\/a> as they can determine when and how often search engine crawlers visit your website, which can have far-reaching implications.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you\u2019re creating a sitemap manually, you\u2019ll need to master the <a href=\"https:\/\/www.sitemaps.org\/protocol.html\" rel=\"nofollow\">use of these tags<\/a>. However, there are a range of tools available online that will fully automate the process (see the \u2018<a href=\"#create-sitemap\">How to create a sitemap section<\/a>\u2019 for more information on this).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">While sitemaps like these give search engines the data they need on your website\u2019s pages, you&#8217;ll also need to learn the anatomy of specific supporting XML sitemaps. That&#8217;s to provide them with key info on your images, videos, mobile and news content.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Supporting XML sitemaps include:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Image XML sitemaps: <\/strong>For relaying information about your website\u2019s images and guiding search engines to the pages they\u2019re located on.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Video XML sitemaps: <\/strong>These provide search engines with key information about the clips you\u2019re hosting, like running time and age restrictions.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>News XML sitemaps: <\/strong>Help search engines pick up any news content you might be hosting. Details might include the language it\u2019s in and access information.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Mobile XML sitemaps: <\/strong>Many websites now optimise their content for tablets and smartphones. With these supporting sitemaps, you can let search engines know exactly where your mobile-friendly pages are located.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"sitemap-types\"><strong>What different types of sitemap are there?<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">As we\u2019ve already touched on, they\u2019re usually <a href=\"https:\/\/www.uplers.com\/blog\/all-about-of-sitemap\/#:~:text=There%20are%20basically%20two%20types,Sitemaps%20(both%20the%20types).\" rel=\"nofollow\">split into two types<\/a>: HTML sitemaps and XML sitemaps. Both can bring SEO benefits, but there are important differences between them that you\u2019ll need to grasp.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Let\u2019s start with the HTML variety, since we haven\u2019t explored them in any detail so far. These are mainly useful for visitors to your site, offering them clear pathways to navigate its pages and content. A HTML sitemap is basically a hub that lays out your site\u2019s table of contents in a visible format for the user. Adding Cascading Style Sheets (CSS) can make the experience more visually appealing for them.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As well as boosting your site\u2019s user-friendliness, having a HTML sitemap can improve your website\u2019s SEO, but their XML counterparts make this a bigger priority.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Indeed, XML sitemaps are <em>only <\/em>used by search engines to crawl the contents of your site. They&#8217;re not meant to be visible to site visitors since they take the form of an xml file placed in the website&#8217;s root directory. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Not only do they provide a roadmap for Google and co. to follow, they contain specific information about your website. For example, how often it\u2019s updated. So search engines can understand it contextually and rank it appropriately.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Within the broad XML category, there are also supporting XML sitemaps for news, video, image and mobile content (see the previous section for more on these).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/submit-sitemap.png\" alt=\"map with an empty journal\" class=\"wp-image-4917\" srcset=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/submit-sitemap.png 600w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/submit-sitemap-300x200.png.webp 300w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/submit-sitemap-370x247.png.webp 370w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/submit-sitemap-270x180.png.webp 270w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"create-sitemap\"><strong>How to create a sitemap<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Creating a sitemap manually involves a lot of legwork. To start, you&#8217;d need to thoroughly review the structure of your site and draw up a template of its pages and content. Then create a hierarchy of pages based on how you want them to be indexed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Next, you will need to manually code your URLs and validate the code before adding the sitemap to the root and robots.txt. Not only does this call for a degree of technical know-how, there\u2019s also the margin of error to take into account. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Luckily, there are handy tools that can take the pain out of the process by generating and checking your sitemap for you. The 20i Sitemap Generator is an example of such tools. <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It&#8217;s a simple one-click tool that uses a bot to crawl your website. It will create a sitemap of accessible pages automatically, obeying all robots.txt restrictions along the way. What\u2019s more, you can set it to automatically update your sitemap at preset intervals to make sure your latest content is listed.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"submit-sitemap\">How to submit a sitemap to Google<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Once your sitemap is firmly in place, you\u2019ll need to submit it to search engines. The easiest way to do this is through <a rel=\"nofollow\" href=\"https:\/\/search.google.com\/search-console\/about\">Google Search Console<\/a>. If you\u2019ve never used Search Console before, it\u2019s straightforward to get started with it through the link.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once you\u2019re on the dashboard, select \u2018Sitemaps\u2019 within the \u2018Index\u2019 section of the side menu. Then enter the URL (e.g. yourwebsite.com\/sitemap.xml).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It\u2019s obviously a good idea to sweep your sitemap for errors earlier in the process (see the next section for more on this) as Google takes over once you\u2019ve clicked that \u2018Submit\u2019 button.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once you\u2019ve submitted your sitemap, crawlers should be able to index your website with greater ease and accuracy. In turn, it could lead to gains in the search engine results.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"test-sitemap\">How to test a sitemap<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Human error is possible if you\u2019ve coded it yourself, and this could mean that your sitemap doesn\u2019t function the way it\u2019s supposed-to. There are tools available online to help you validate your sitemap\u2019s code and make sure there are no syntax gaffes.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"600\" height=\"400\" src=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/test-sitemap.png\" alt=\"map with a compass\" class=\"wp-image-4916\" srcset=\"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/test-sitemap.png 600w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/test-sitemap-300x200.png.webp 300w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/test-sitemap-370x247.png.webp 370w, https:\/\/www.20i.com\/blog\/wp-content\/smush-webp\/2020\/09\/test-sitemap-270x180.png.webp 270w\" sizes=\"auto, (max-width: 600px) 100vw, 600px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">One of the most popular sitemap checkers is the <a rel=\"nofollow\" href=\"https:\/\/www.xml-sitemaps.com\/validate-xml-sitemap.html\">XML Sitemap Validator<\/a>. This automatically sweeps your sitemap for errors when you input its URL into the system. Something as simple as a missing tag is enough to throw a spanner into your website\u2019s works. This application seeks out these errors so you can fix them quickly.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Alternatively, once you&#8217;ve submitted your sitemap in Search Console you can see errors by clicking on &#8216;See Index Coverage&#8217; in the right-hand column. You&#8217;ll then get a report. This is useful as a last-minute safety net, though seeking out errors before this point is recommended.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Hopefully that covers everything you need to know about sitemaps. Let us know if you have any questions!<\/p>\n","protected":false},"excerpt":{"rendered":"A sitemap is a roadmap to your website. It gives search engines and users easy access to its&hellip;","protected":false},"author":15,"featured_media":4931,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"ub_ctt_via":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"csco_singular_sidebar":"","csco_page_header_type":"","csco_page_load_nextpost":"","footnotes":""},"categories":[292,51,60],"tags":[65,81,80,57,79,76],"class_list":["post-4896","post","type-post","status-publish","format-standard","has-post-thumbnail","category-seo-digital-strategy","category-technology","category-web-design-dev","tag-google","tag-internet","tag-seo","tag-web-design","tag-web-development","tag-wordpress","cs-entry"],"featured_image_src":"https:\/\/www.20i.com\/blog\/wp-content\/uploads\/2020\/09\/SItemap-guide.png","author_info":{"display_name":"Mark Langshaw","author_link":"https:\/\/www.20i.com\/blog\/author\/mark-langshaw\/"},"_links":{"self":[{"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/posts\/4896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/comments?post=4896"}],"version-history":[{"count":31,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/posts\/4896\/revisions"}],"predecessor-version":[{"id":11648,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/posts\/4896\/revisions\/11648"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/media\/4931"}],"wp:attachment":[{"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/media?parent=4896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/categories?post=4896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.20i.com\/blog\/wp-json\/wp\/v2\/tags?post=4896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}