gadgetsforjoven

How to Get Google to Instantly Index Your Newly built Website

Organic search traffic is critical for growing your website and business.

Some research claims around 53% of your site’s traffic can be attributed to organic search.

But the stats don’t matter much if your site doesn’t show up in the search results at all.

How do you get your new site or blog indexed by Google, Bing, and other search engines?

Well, you’ve got two choices.

You can take the “tortoise” approach – just sit back and wait for it to happen naturally, but this can take weeks or months.

(Trust me, I’ve been there before – not fun.)

Or you can make it happen now, giving you more time and energy to put towards increasing your conversion rate, improving your social presence — and, of course, writing and promoting great and useful content.

I don’t know about you, but I’d rather get my sites indexed as quickly as possible because it gives me more time to build my audience.

These strategies are exactly how I grew this blog to over 600,000 monthly visitors as fast as I did!

Stick around, because I’m spilling the beans on everything I’ve learned about SEO and how to get your website indexed fast in this step-by-step guide!

I’m going to walk you through how to get Google to index y our website quickly, which will bring you more organic search traffic and higher rankings.

Let’s get started!

Why Do You Need Google to Index Your Site?

First, the obvious answer.

If you want your site to show up in the search results at all, then it needs to be indexed.

However, you don’t want your site to be indexed just once. You want the search engines to keep re-indexing your site.

Search engines like Google don’t just update automatically.

They rely on spiders — little bits of computer code that each search engine sends out to “crawl” the web (hence, “spider”).

You want an efficient, frequent crawl rate.

The spider’s job is to look for new stuff on the web and update the already indexed version of your site. That “new stuff” can be a new page on an existing site, a change to an existing page, or an entirely new site or blog.

Once the spider finds a new site or page, it needs to figure out what that new site or page is about.

Way back in the Wild Wild West of the early web, search engine spiders weren’t nearly as smart as they are today. You could force a spider to index and rank your page based on nothing more than how many times a particular search phrase (“keyword”) appeared on the page.

For today’s content success, you can’t rely on these old school search engine optimization strategies.

The keyword didn’t even have to be in the body of the page itself. Many people ranked for their biggest competitor’s brand name just by stuffing dozens of variations of that brand name in a page’s meta tags!

Fortunately for Google search users and ethical website owners, those days are long gone.

Today, keyword and meta tag stuffing will get you penalized, not rewarded. And meta keyword tags aren’t really part of the algorithm at all (though there are still good reasons to use them).

If you’re not careful, you could get your site kicked out of the index altogether — which means your site won’t rank for any keywords at all.

These days, Google is more concerned with the overall user experience on your site and the user intention behind the search — i.e., does the user want to buy something (commercial intent) or learn something (informational intent)?

They even made Page Experience a ranking factor.

Don’t get me wrong — keywords still matter. Other factors are also important — up to 200 altogether, according to Brian Dean of Backlinko. These include things like quality inbound links, social signals (though not directly), and valid code on all your pages.

None of that will matter if the spiders can’t tell the search engines your pages are there in the first place, meaning they won’t show up in search results.

That’s why website indexing is so important.

To put it simply, indexing is the spider’s way of gathering and processing all the data from pages and sites during its crawl around the web.

Frequent indexing improves your search results.

The spider notes new documents and changes, which are then added to the searchable index Google maintains. Those pages are only added if they contain quality content and don’t trigger any alarms by doing shady things like keyword stuffing or building a bunch of links from unreputable sources.

When the spider sees a change on your website, it processes both the content (text) on the page as well as the locations on the page where search terms are placed. It also analyzes the titles tag, meta tag, and alt attributes for images.

That spider then adds, or “indexes”, that content into Google.

That’s indexing in a nutshell. It is an essential webmaster tool.

When a search user comes along looking for information by typing in search keywords, Google’s algorithm goes to work. The algorithm then decides where to rank a page in comparison to all the other pages related to those keywords.

How often your site is indexed can affect your performance in search results. You want to make sure all your latest content is available for those searching and Google’s spiders at all times.

That’s the short and somewhat simplified version of how Google finds, analyzes, and indexes new sites like yours.

Many other search engines, like Bing or Yahoo, follow similar procedures, though there can be variations in the specifics as each has its own algorithm.

What Website Indexing Factors Matter?

You want an efficient index rate for your website.

That means you want search engine spiders to find your new content as quickly as possible after you hit publish.

You can check how often Google is crawling your pages by logging into Search Console.

Not set up with Google Search Console yet? Jump down to Step 2 to learn how to get your website set up.

In Search Console, click on your website. Then click on Settings > Crawl Stats > Open Report. You’ll see some graphs like this:

The first graph shows how often Google is crawling your site.

That graph — the “Crawl requests” one — shows how often Google is crawling my site each day.

As a rule of thumb, the more crawling the better.

There are some cases, however, where too much crawling can overload your server resources. Typically it’s the result of a server misconfiguration instead of an issue with Google’s spiders.

This is very rare though, so you probably won’t need to worry about this. Google allows you to change the crawl rate (only down, not up) if this is happening to you.

So how did I increase my crawl rate?

I’ve been posting a lot lately and updating older content, so Google is eager to get all my updates and changes as fast as it can. It’s learning to check in with me more often.

I also switched to a new web host in April that is much faster than my old one.

The faster your site loads, the faster Google can come in and index it!

Google wants to recommend the best websites to its users. It looks for sites that offer a good user experience. While that includes many factors, quality content and site loading speed is highly important.

To put it simply:

Faster site = better user experience.

Better user experience = higher search result rankings.

More important than how often Google indexes your site is how many pages it’s indexing. You want to ensure as many of the pages on your site as possible are indexed.

(Don’t worry, your sitemap will take care of that, which I cover in detail in Step 7.)

But first, let’s start at the beginning. The following 18 steps will guide you through everything you need to know about getting your website indexed.

You don’t necessarily need to do all 18 steps to have a well-indexed website, but if you’re wondering how to rank higher in Google, this is the only guide you’ll ever need!

Step 1: Is My Site Indexed Already?

Unless you’re starting a brand new site, your website is probably already indexed.

If you’re not sure, here’s how to find out.

The easiest way to check this is to search site:yourdomain.com in Google. If Google knows your site exists and has already crawled it, you’ll see a list of results similar to the one in the screenshot below:

If Google hasn’t yet found your site, you’ll get no results at all, similar to this:

If your site is already indexed, that’s great, but there is likely room for improvement.

The rest of the steps in this guide will help you make sure that your site is indexed to its full potential.

tep 2: Install and Set Up Google Analytics & Search Console

If you’re not already familiar with these free Google tools, here’s a quick breakdown.

Google Analytics: Measures stats about your website like visitors, time spent on site, what pages they looked at, where they’re from, etc.

Google Search Console (formerly known as Google Webmaster Tools): It allows you to monitor different aspects of your website like when it was last crawled, any indexing errors, security issues, etc.

Search Console also lets you manage some key aspects of how you appear in search results and manually submit sitemaps — I’ll cover all of this later on in this article.

But first, let’s get set up.

If you already have Google Analytics and Search Console, click here to skip ahead to Step 3: Create a content marketing strategy.

To set up Google Analytics, click here and sign in with your Google account.

This would be either your @gmail.com email address or your @mydomain.com email address if you use Google’s G Suite for Business service.

Sign Up.

Enter your website name and URL, then click Get Tracking ID at the bottom of the page.

Google Analytics Setup

If you’re using WordPress or another content management system that is asking you for your Google Analytics Tracking ID, then you just need the number at the very top.

That’s not my real tracking ID! Just saying, don’t post that online! 😉

The WordPress plugin Google Analytics by MonsterInsights is really easy to set up.

Just download it, upload the plugin to WordPress, activate it, and you’ll see this screen.

monster insights to install Google analytics

Press the blue “Authenticate” button and it walks you through the rest.

To set up the plugin, you need to have an Analytics profile already created, which we did in the previous step.

If you’re not using WordPress or want to add your Analytics code manually, here’s how to do that.

You need to put this code (in the red box) onto every single one of your website’s pages.

The easiest way to do this is to create one file with the code in it and then create a line of code on each of your website’s pages that pull in that file.

Piece of cake, right?

Don’t worry, here’s how to do that!

For this step, you need to be able to access your website files on your web hosting company’s server. This is commonly done via FTP.

Open up your FTP client (FileZilla is a great, free one) and login to your server. If you don’t have this information, you can create an FTP account in your web host’s cPanel, or just contact your web host to ask them for the information.

Once you’re connected, you’ll see a list of files and folders.

Open up a new text file (Notepad for Windows or TextEdit for Mac are fine for this). Make sure it’s set to Plain Text Only.

In TextEdit, you click on Format -> Make Plain Text to do that.

index website install tracking script

This is really important because word processors like Word can add formatting to the code that can mess up the coding on your site. When working with code, always use plain text.

Once you have your plain text document, paste the Google Analytics code. You’ll end up with this:

index website install tracking script

Save your file as analyticstracking.php. Make sure it has the .php extension on it and not .txt.

index website install tracking script

If your text editor saved it with the name “analyticstracking.php.txt” for some reason, just rename the file on your computer to “analyticstracking.php”.

index website install tracking script

Upload this file to your root directory via FTP (the first folder of your website).

You need to add one line of code for each page template you have. This “calls” the file we just made and ensures every page of your website that uses that template is tracked in Google Analytics.

To do that, download all your website PHP template files and edit them.

If you have one named header.php that loads on every page, you only need to do this once!

Download header.php.

index website install tracking script

Next, open up the downloaded file in your text editor.

Look for the </head> tag and the beginning of <body>, like this:

index website install tracking script

Insert one line of code right after the <body> tag.

Copy this code: <?php include_once(“analyticstracking.php”) ?>

And paste it here:

index website install tracking script

Save your header.php file, and reupload it to your website.

Done!

If you don’t have a header.php file, you need to repeat this process for each php page template you have on your website, like index.php, blog.php and so on.

If you use WordPress, you’re definitely at an advantage. All you need to do is install a plugin.

Okay, one more thing to set up and we’ll move on to Step 3.

Google Search Console Setup

Now that we have Analytics set up, it’s time to add our website to Google Search Console (formerly known as Google Webmaster Tools).

Click here to go to the Search Console. Log in with your Google account.

You’ll see this screen:

Google search console setup index website guide

Click “Start now.”

You’ll then need to verify that you own that domain. There are a few ways to do this.

By default, it may show you a verification option through your web host.

index website search console

Click on the dropdown to find your domain name provider.

If yours isn’t on the list, you can press Other (at the bottom).

Search Console then asks you to create a TXT record, which involves an edit to your domain configuration.

index website sign up for search console

Is this a little over your head? Not to worry, I’ve got a much easier way!

If you still want to add a TXT record though, here’s how.

Click on Alternate Methods at the top.

index website sign up for search console

There are two easy ways to verify your domain: with Google Analytics or via an HTML file upload.

I’ll cover both of them.

index website sign up for search console

To verify with Google Analytics, just select it and click Verify.

Google will check your Analytics account to make sure you are who you say you are, and if you are, you’ll see a success message. Make sure you’re using the same Google account with Search Console that you do with Analytics.

The process is still pretty easy with the HTML file upload method.

Click to download the file to your computer in step 1, then open up your FTP program again. Upload Google’s HTML file to your root directory.

index website sign up for search console

Next, visit the URL Google gave you to make sure the file is there. In my case, that’s https://neilpatel.com/googlefba739b2a6dd0306.html.

If you uploaded it correctly, you’ll see the filename in your browser window.

index website sign up for search console verification

Go back to Search Console and click Verify at the bottom.

That’s it!

Make sure to leave the HTML file on your server. It ensures that your website will stay verified with Search Console.

There are two more really important things you need to do now:

  • Add both the neilpatel.com and www.neilpatel.com versions of your domain
  • Set a preferred domain

Why do you have to do that, you ask?

It can cause crawl errors, which we are trying to avoid!

Adding the other version of your URL is easy – repeat the same process that I just explained. In the example above, I verified my neilpatel.com domain. So I would go into Search Console and do the exact same steps but use “dubainepal.com” instead.

Once you have both “yourdomain.com” and “www.yourdomain.com” added to Search Console, you need to set the preferred domain.

To do that, click on your website in Search Console.

At the top-right corner, click the gear icon and click Site Settings.

Select if you’d like your URLs displayed with the “www.” or without.

I’m going to show you all the awesome things you can do with Search Console later in this article, so keep that tab open!

But now, we need to get back to marketing fundamentals and talk about creating an SEO strategy for your content.

Step 3: Create a Content Marketing Strategy

It’s for your own benefit to have a written content marketing strategy that’s focused on search results.

But don’t take my word for it.

From the Content Marketing Institute: 

“Those with a documented content marketing strategy:

  • Are far more likely to consider themselves effective at content marketing
  • Feel significantly less challenged with every aspect of content marketing
  • Consider themselves more effective in their use of all content marketing tactics and social media channels
  • Are able to justify spending a higher percentage of their marketing budget on content marketing”
index website create a content marketing strategy

All of those things are absolutely true. For me, I feel a lot more on track when I have a written plan of action that I can refer to and track my success.

My blogs and multiple businesses would not have grown as quickly as they did without having a written plan.

In addition to keeping you focused on your goals, a documented content strategy also helps you get your site’s pages indexed by creating new pages of content.

According to HubSpot’s “Not Another State of Marketing Report 2020” , 60 percent of content marketers said content is very important or extremely important to their overall strategy.

One study found that companies that use content marketing enjoy conversion rates that are six times higher.

Doing your best to publish valuable, interesting, and useful content and then doing everything you can to make sure that your potential customers see it.

Here’s an example.

When I create and publish a professional infographic on my site and it gets shared on another web page with a link back to my page, I get content marketing “credit” for both posts.

Since it’s an infographic, I’m more likely to engage my audience on both sites.

Infographics have one of the highest reader engagement rates. It’s been proven that most people spend longer looking at infographics than they do reading the text on the page.

But you’re totally reading this, right?!

Infographics get shared on social media about 3x more than any other type of content.

When you’re putting together your content marketing strategy, blogging definitely needs to be on the list.

But you also need to factor in content that you’ll publish on other websites. This not only helps grow your traffic but also helps with indexing speed and obtaining inbound links.

Here are some examples of offsite content to go into your plan:

  • Guest posts on other sites in your niche
  • Press releases submitted to sites that publish that kind of content
  • Articles on high-quality article directory sites (Note: Be careful here — the vast majority of article directories are not high quality and can actually hurt your brand, reputation, and SEO.)
  • Some reputable directories are Medium and HubPages.
  • Videos hosted on Vimeo or your YouTube channel.

Of course, any content you put your name or brand on must be high quality and published on a reputable, authoritative site.

Otherwise, you’re defeating the purpose of search engine optimization and hurting your traffic and brand in the process.

Content that’s published on “spammy” sites with a link back to your site suggests to Google search results that your site is also spammy.

Examples of reputable sites to guest post on might be Forbes, Entrepreneur, Smashing Magazine, etc. These are well-known websites with a reputation for quality content, which is exactly what you want to be associated with your brand.

Not so good places to post? Sites full of low-quality red flags: cluttered with ads, lots of grammatical or spelling mistakes, or unknown in the industry you’re trying to target.

I don’t want to name any names here, but your common sense should be enough to tell you what a spammy site is. For example, a site named “neilsbestmarketingadvice101.tumblr.com” is probably not going to do much for you, right?

A well-thought-out content marketing plan helps you avoid getting tripped up in the mad rush to publish more content. It puts you in the driver’s seat of search engine optimization so you can focus on generating leads and increasing your conversion rate.

Creating a written content strategy doesn’t have to be difficult.

Here’s the framework I use for mine:

  • What are your goals? Specify SMART goals and how you’ll measure your progress (i.e., metrics).
  • Who is your target audience? Customer profiles or personas are essential to understanding your audience and what they want/need.
  • What types of content will you produce? You want to make sure you’re delivering the type of content that your target audience wants to see.
  • Where will it be published? Of course, you’ll be hosting your own content on your website, but you may also want to reach out to other sites or utilize platforms such as YouTube, LinkedIn, and Slideshare.
  • How often will you publish your content? It’s far better to produce one well-written, high-quality article a week consistently than to publish every day for a week and then publish nothing for a month. Consistency is key.
  • What systems will you adopt for publishing your content? Systems are basically just repeatable routines and steps to get a complex task completed. They’ll help you save time and write your content more quickly, so you can stay on schedule. Anything that helps you publish content in less time without sacrificing quality will improve your bottom line.
  • What tools will you use? Include the blogging/content tools and technology you’ll use and how they fit into your system.

Once you have your content marketing plan documented, you’ll find it easier to publish great content on a consistent schedule. This will help your site’s new web pages get indexed faster.

Step 4: Start Blogging

Why do you need a blog?

It’s simple: Blogs are hard-working SEO machines. Blog content gets crawled and indexed more quickly than static pages.

Blogs also bring in more traffic. Businesses that blog regularly generate 55% more visitors to their sites than those that don’t.

Blogging works for every kind of business, industry, or niche, as well as for almost all business models — even B2C and e-commerce sites.

Don’t be afraid of committing to a blog.

Yes, it does require consistent effort. You do have to write (or outsource) high-quality, in-depth blog posts on a regular basis.

The rewards, I’ve found, are absolutely worth it.

If you have an ecommerce site, blogging doesn’t have to be terribly complex or difficult.

For example, when you create a new product page, write and publish a blog post about the new product. Add quality images of the product and link to the product page. This helps the product page get indexed more quickly by search engines.

Another great blogging strategy for ecommerce is to write a post every time a customer asks you a question.

For more of a sales-oriented strategy, share that blog post link with other bloggers and influencers to get the word out. Maybe they’ll want to feature your product on their blogs, which again is a great source of links and traffic and will positively impact your crawl rate.

Step 5: Use Internal Links on Your Website

Internal links, i.e. linking to pages on your own website, is another great way to get indexed quickly and increase your position in organic search results.

One very obvious source of internal links is your website’s navigation.

It’s important to structure your website navigation in such a way that it makes sense to Google.

Your navigation should follow a predictable flow like Homepage -> Category -> Sub Page.

All elements should be obviously related. So if you are a web designer, your navigation might look like this.

Homepage -> Web Design Services -> WordPress Design

See how those are all related and make sense?

Another key factor is to structure your URLs properly. Google’s rule of thumb is for them to be as simple and straightforward as possible.

So if it makes sense to you, a human, it should make sense to Google too.

Another great way to link to your content is in blog posts.

People typically link phrases in their blogs over to relevant topics, like if I wanted to offer you more information on URL structuring.

Or, I could create a line like this:

Related: Does URL Structure Even Matter? A Data Driven Answer

This builds links, which causes Google’s spiders to come back and crawl those pages again. Also, it positively adds to the user experience. Your readers will appreciate the further resources.

Remember to keep user experience in mind at all times. It goes hand in hand with SEO. Google has all these rules and ways it works because it’s trying to deliver the best results to its users and give them the answers they’re looking for.

You should be focused on the same thing!

Step 6: Promote Social Sharing of Your Content

Naturally, getting people to share your content on social media is a good thing. Pretty sure I don’t need to convince you about that!

It exposes your content to new people, attracts them to your website, and it’s the kind of content people want to see the most.

But sharing your posts on social media also has SEO benefits, because it creates links back to your content.

Which, if you’ve been paying attention… tells Google’s spiders to go index your site

Bonus points if you already guessed that.

There is some debate out there about just how much social media links factor into organic search rankings.

Google has mixed statements on the subject, saying at first in 2015 they did not factor in social media posts to organic search ranking at all and then later saying they did.

Step 7: Add a Sitemap Plugin to get Google to Index Your Site

First, let’s talk about what a sitemap is.

You’ve undoubtedly seen the word “sitemap” before – but maybe you never knew exactly what it meant and how it relates to search engine optimization.

A sitemap is a file that tells Google about the files on your website, including how they relate to each other. This makes it easier for Google to crawl and index your site.

Step 8: Submit a Sitemap to Search Console

It’s crucial to ensure your sitemap is up to date with Google Search Console. I like to go in once every 2 weeks, or at the very least monthly, and update it.

Not signed up for Google Search Console yet? Head back to Step 2 to see how.

Click the URL to go to the Dashboard for that site. On the left, under “Index” click “Sitemaps.” You’ll see the sitemaps already submitted to Google as well as add a new sitemap.

Leave a Reply

Your email address will not be published. Required fields are marked *