How You Can Ask Google To Recrawl URLs From Your WordPress Site
Recently one of our readers asked if it is possible for Google to crawl specific URLs? If your website is new, Google takes some time to crawl and display new pages or changes to the search results. In this article, we’ll show you how to ask Google to recrawl URLs from your WordPress site.
When and why should you ask Google to recrawl URLs?
When you add pages and messages to your WordPress site, Google will take the necessary time to crawl these new links. Google requires the same time to crawl the updated URLs from your WordPress site.
When you manually ask Google to recrawl your URLs, your new link is queued to be indexed on Google. A Google search bot will start by recording your links one by one and displaying them in the search results.
Some common reasons for asking Google to re-crawl URLs are:
- When you add a new post or page
- When you make changes to an existing post or page
- If you think a page should be indexed in Google, but you cannot find it
For the first two options mentioned above, you can automate this process with XML sitemaps. Google is pretty good at indexing websites because that’s their business.
However, we have seen that certain pages of Google have disappeared (without reason). If you just ask Google to recrawl, the page will be displayed immediately.
However, let’s see how we can ask Google to re-crawl URLs from your WordPress site and display them in search results.
Ask Google to crawl URLs from your WordPress site again
First, you have to display your site on Google and then Google automatically starts crawling your URLs. However, you can also ask Google to recrawl your new links for all the cases we discussed above.
You can follow the steps below to ask Google to recrawl URLs from your WordPress site.
Step 1: Use the URL Inspection Tool to re-crawl URLs
URL inspection tool is available in the new and updated Google search console (formerly known as Google webmaster tools). With this tool, you can identify the problems associated with your URLs and offer solutions to index your links in Google.
It also helps you resolve common WordPress errors for your URLs and other URL indexing issues.
In the new Google search console, you must select your property or website to check the URL index status.
Note: If you don’t list a website in the Google webmasters tool, you must first add it as a new property to continue with the URL inspection tool.
After selecting the property, you must go to the URL Inspection tool in the left menu and add your URL to the search field that you want to inspect.
It gets the information about your URL and displays it on the Google Search Console dashboard.
If your URL is on Google, you will see a success message with useful information about your link. You can expand the findings and see if there are any other problems that need to be solved. If not, the submission request from Google will be displayed to re-crawl and index your URL.
However, if the link is not on Google, the errors and a possible solution are shown to have your URL indexed on Google.
You can resolve the issues and review the URL until you receive the success message. A request is then submitted to re-crawl your URL. Just repeat the same for all the URLs that you want Google to crawl.
Step 2: Send XML Sitemap to re-crawl URL
If you are still unsure of indexing your URLs on Google, you can easily submit an updated XML Sitemap with your new URLs to Google webmaster tools. Sitemaps are the fastest way to index your new URLs on Google.
For this step, we recommend that you use the Yoast SEO plug-in that contains flexible options to correctly set up your XML sitemaps in WordPress.
In your WordPress management area, you must go to the »General» page of SEO. In the Functions section, you must enable the XML Sitemaps setting.
Do not forget to click on the Save Changes button.
You can then view the updated Sitemap by clicking the question mark icon next to the XML Sitemaps heading. If your new links are visible in this sitemap file, you can continue and submit it to Google webmasters tool.
To submit the XML sitemaps, you must visit the new Google Search Console and go to Sitemaps in the menu on the left. Simply add your XML Sitemap link and click the Send button.
In this updated sitemap, Google bots are asked to quickly recrawl your new URLs and display them in the search results.
Note: you only need to upload the sitemap once. Google crawls your Sitemap regularly and quickly adds updated messages once your sitemaps have been added.