When fetching the sitemap for a domain URL, we first check for the sitemap URL in the domain's robots.txt file. Sample URL for robot.txt: www.example.com/robots.txt.
If a sitemap URL is not found, we check if the sitemap is present at the following URLs for the domain: www.example.com/sitemap.xml or www.example.com/sitemap_index.xml.
If the sitemap is not found at any of these locations, we return a failure.
