DebutBoard / Guides / How Google finds a brand-new website

How Google finds a brand-new website

A new site doesn't show up in Google the day it launches. This guide covers how Google actually finds it, the three things worth doing on day one, and what to stop worrying about.

The most common question after a launch is some version of "why can't I find my site on Google?" The honest answer is that Google hasn't gotten to it yet. Google doesn't get a list of new websites. It has to stumble onto yours, then decide to visit it (Google calls visiting a page "crawling"), then decide to put its pages in its index, the giant list of pages it can show in results. Each step takes time.

You can't skip those steps, and nobody can sell you a way around them. What you can do is make sure Google hears about your site, has a map of it, and finds nothing that tells it to go away.

How Google finds pages in the first place

Google's own starter guide puts it plainly: Google mainly finds pages by following links from pages it has already visited. A site that nothing links to is hard to find. That's why a brand-new site with no links is in the slowest possible spot.

The second way is a sitemap, a file that lists the pages on your site. Google says a sitemap helps but isn't required. For a new site with few or no links pointing at it, it's the most useful thing you can hand over.

Finding a page isn't the same as showing it. After Google crawls a page, it decides whether to index it, meaning store it so it can appear in results. Google doesn't promise to index every page it crawls.

Step 1: Set up Google Search Console

Search Console is Google's free dashboard for site owners. It shows whether your pages are indexed, what people searched to find you, and any problems Google ran into. Go to search.google.com/search-console, sign in with the Google account the business will keep, and add your site. You'll be asked to pick one of two kinds of "property":

  • Domain property. Covers your whole domain, with or without www, http or https. The only way to prove you own it is to add a line of text Google gives you (a TXT record, or in some setups a CNAME record) to your domain's DNS settings. DNS is the settings page, usually at your domain company, that controls where your domain's website and email go. It's a copy-and-paste job, but you need that login.
  • URL-prefix property. Covers one exact address, like https://www.yoursite.com/. You can verify it more ways: uploading an HTML file, adding a meta tag to your home page, or through Google Analytics, Google Tag Manager or DNS.

If you can get into your DNS settings, the Domain property is the better pick because it catches every version of your address. If your designer controls the site but you don't have DNS access, a URL-prefix property with the meta tag is the usual workaround.

Step 2: Submit your sitemap

Most site builders make a sitemap for you. It's usually at yoursite.com/sitemap.xml. WordPress sites since version 5.5 have one at /wp-sitemap.xml unless an SEO plugin replaced it with its own. Open the address in a browser. If you see a list of your pages, you have one.

In Search Console, open Sitemaps, paste the sitemap's address and press Submit. You can also add a line like this anywhere in your robots.txt file (a small text file at yoursite.com/robots.txt that tells search engines which pages to skip), so other search engines find the sitemap too:

Sitemap: https://www.yoursite.com/sitemap.xml

Google says submitting a sitemap is "merely a hint". It doesn't force anything. It just saves Google from having to discover each page by itself.

Old advice you can skip: you may read about "pinging" Google with your sitemap's address. Google announced in June 2023 that the ping address would stop working within six months, and that shutdown is complete. Search Console and robots.txt are the ways to tell Google about a sitemap now.

Step 3: Ask Google to look at your home page

In Search Console, paste your home page's address into the search bar at the top. That's the URL Inspection tool. It tells you whether Google has the page. If it doesn't, press Request indexing.

Three things to know about that button:

  • There's a daily limit. Google doesn't publish the number.
  • It doesn't guarantee the page gets indexed. It puts the page in line to be crawled.
  • Pressing it again for the same page doesn't move it up the line. Do it once and wait.

Use it for your most important pages: the home page, your main service page, contact. For everything else, the sitemap does the job.

How long it takes

Google's documentation says crawling can take anywhere from a few days to a few weeks. Its help page for a single request says it typically takes a day or so, and can take a week or two. A brand-new domain with no links tends to sit toward the slow end.

Google is also direct about money: it doesn't accept payment to crawl a site more often or to rank it higher. In its words, "If anyone tells you otherwise, they're wrong." Treat any call or email promising to "get you on page one of Google" by next week with that in mind.

How to tell whether you're in

Many people search site:yoursite.com to see what Google has. That's a rough check at best. Google says a site: search doesn't necessarily return every page it has indexed. For a real answer, use URL Inspection on the page itself, or open the Page indexing report (listed as Pages in Search Console's menu).

That report sorts your pages into indexed and not indexed, with a reason for each. Two reasons show up a lot on new sites, and neither one means something is broken:

StatusWhat it means
Discovered – currently not indexedGoogle knows the page exists but hasn't visited it yet. Usually it put off the visit so it wouldn't overload your server. Wait.
Crawled – currently not indexedGoogle visited and chose not to index the page for now. It may later. Google says there's no need to resubmit it. If it's an important page, make it more useful and make sure your other pages link to it.

Things that quietly keep a page out

  • A noindex tag. Often left on from when the site was being built. See the launch checklist for how to find it.
  • A robots.txt block, used the wrong way. Robots.txt tells Google which pages not to crawl. It doesn't hide them. Google says a blocked page can still show up in results, as a bare address with no description, if other pages link to it. If you want a page kept out of Google, use noindex and don't block it in robots.txt, or Google never gets to see the noindex.
  • A "not found" page that says everything is fine. If a missing page shows a "not found" message but sends a success code instead of a "not found" code (404), Google calls it a soft 404. Your real pages and your fake ones start to look alike.
  • Pages nothing links to. If a page isn't in your menu, your sitemap or any other page, Google may never find it.
  • Thin or copied pages. Ten near-identical "service in [town]" pages with the town name swapped don't help. Google's spam policies treat city-by-city pages that all funnel visitors to the same place as "doorway abuse", which can hurt the whole site.

What actually helps over the next few months

Once the setup is done, ranking comes down to the same things for a five-day-old site as a five-year-old one. Google's guidance on "helpful, reliable, people-first content" asks questions like these about each page:

  • Is the information original, or a rewrite of what other sites already say?
  • Will someone who reads it leave knowing enough to do what they came to do?
  • Does it show first-hand experience, such as having actually done the work or used the product?

Google also suggests thinking about Who made the content, How it was made, and Why. The "why" it wants is to help people, not to pull search traffic.

The other slow, real lever is links from places that make sense: your trade association, your suppliers, the chamber of commerce, a local news story, a sponsor page for the team you sponsor. Buying links to boost your ranking is a different thing. Google's spam policies call that "link spam". Our first-visitors guide covers the honest ways to get early links and traffic.

If you meet customers in person, a Google Business Profile is often how you'll show up in Maps and local results long before your website ranks on its own.

Sources

Just launched a site? List it on the debut board. It's free, there's no account, and new listings are reviewed before they go up.