Make site searchable & indexed in search engines — What all you need to do
When you want to do or start SEO for any website, the first and foremost task to achieve is to get your website on Google and other search engines.
Before you aim to make your site rank or get your website on Google first page you need to ensure that your website gets found on Google and other major search engines like Bing, Yahoo, which your users will be using to find your website through search.
This calls for two things. The first thing to do is to make sure your website can be easily accessed and understood by search engines like Google when they find it, by taking steps we list below. The second thing is submitting your site manually to all major search engines as and when it is needed through proper ways we explain here.
The third thing which you need to do, and keep track of, is that your website and its content remains indexed and searchable and does not fall off the search radar when you make changes or modifications to your site and its content.
What also you need to look for is all the new and changed pages get indexed and are made searchable.
Why get your website on Google, Bing, Yahoo and more
You must have heard this phrase "Content is King". But a King needs to reach out to its people (audience) to be good and effective. If the people (target audience) do not even know that there is a King at all, then the question of being good (or even bad) does not even arise.
Search engines are the biggest platforms (and Google is the largest among them) which make your website reach to your target audience.
Search engine optimization means targeting organic traffic for a website. This organic traffic means traffic from searches that people make. This traffic comes only from search engines. This means you want traffic from Google, Bing, Yahoo and other search engines.
Most importantly you need to target Google search engines traffic and submit website to Google. Then or along with it you should also target traffic from Bing and Yahoo search engines. So you should also submit site to Bing and to Yahoo as from their also you can get some number of search traffic.
Website can surely target this traffic by way of keyword optimization, off page activities, and other things but there are all the more important things that you need to do before you start all this.
That is to make your website ready so that you get full benefits from search and SEO.
Submitting a website and URLs for indexing are needed at three stages:
- When creating a new website
- When creating new pages for a website
- When changing page content, theme or even layout for an existing page
Hence, it is the most important aspect of SEO and of search too. This is because if websites are properly submitted then, first, the website will not get the right traffic or any traffic at all. Second, the search visitors may not be able to get the best information from search.
So, let us see what all steps you need to take to get your website in the search.
Ready website for indexing
The first thing you need to do is to make your website ready to be indexed.
What indexing means is that your website is a part of Google's search index or database. More important than this is that your website and its pages are categorized according to theme (s) and keywords and then indexed under all the relevant keyword categories.
Because of this it is not enough to get indexed by search engines. More important than adding your site to search engines for indexing is to make sure you are there for the right keywords and in the right category.
Search engines index new websites by way of crawling. We explained how search engines crawl and index websites here. A website is a collection of web pages that are grouped together through a single domain name and also by way of content coverage on a main subject or theme.
This section where we talk about making a website ready for indexing is the first step you should do, before you actually submit your website to Google and other search engines.
Make sure all pages are reachable and readable
There are two things you need to do. One, make your site accessible to search engines. Second, make the content of each page readable to the search engines.
As a website is group of web pages often about a single theme or concept and connected via a single domain. But this is not enough to make sure that the bots or spiders can access each and every page of your website.
1. Navigation
Use a clear navigation system or menu on your website. All your important pages should be clearly linked and visible in the navigation. There you can also according to your site hierarchy. Like if you provide three different categories of services, each having few types to choose from then your menu could have those three main service categories under services and then within each you can list all the sub sections or types of services which you provide.
A clear and ordered navigation also is a great assets in helping your users to the page that they want to visit and letting them know what all offer and what are you about.
A detailed navigation can also be inserted into the footer of every page.
2. Link Internally
The utility, benefits and advantages of linking internally from one page to another page can never be fully appreciated. You can rank a new web page and bring traffic to it only by properly linking that page internally with other important pages of your website.
What it also does is help all your pages get indexed by search engines. Remember how web crawlers index new websites? Through links. This is exactly how they will explore all your internal pages.
There can always be pages which will not be mentioned in the navigation or your home page. So, one great way of connecting those pages with other important pages is by internal linking.
Here, you link a deeper page H from within the text or content of your higher page B or C. What you actually do is pick words or phrase or sentence in page B which talk about your page H, and use it as anchor text and link it to the page H.
This way you can link pages A, B, C, D, E to inner pages like H, I, M and so on.
3. Accessible Content
It is also important now to make content of all your pages accessible and readable to search engines.
For this, what you need to understand first is that search engines read only text which are orderly placed within the HTML codes. They do not read images, videos, and certainly not read or index flash based content or sites.
So, what you need to do is include necessary and explanatory text if you are using any one of the above mentioned non readable items. For images or videos the best thing to do is briefly explain that image or video is the alt text and Title text, which is a part of on—page technique.
For videos or audio files what you can also do is provide a supplementary transcript on that page.
It would be best to avoid flash on your sites or to include some plain text with those elements.
4. HTML sitemap
This is another way to make sure all your pages are accessible, not only by the search engines but also by your readers.
The HTML sitemap is a simple page where you list all your pages in some order, preferably in the order of their importance or relevance to your business or to your users. It will have all the main pages and their sub pages and also all the internal and unlinked pages as a list. And all the list items or page names will be linked to their respective pages.
This sitemap page can be included in the footer space of every page. It is usually not included in the navigation or menu.
This sitemap page can be included in the footer space of every page. It is usually not included in the navigation or menu.
Use of proper keywords
Keywords optimization and usage is again another big impact on-page SEO optimization technique. This is also relevant for proper indexing of a website. Not just the keywords but the entire text or content of page is important.
The content should be written in clear and methodical way. It should have a clear heading which ideally should be within the H1 tag. That heading should also include main keyword of that page which describes the theme of the entire page content.
This is important to make that page indexed under right and relevant categories of the search engines database. Right indexing will be the first step towards making that page optimize and rank for the right keywords.
Submit site for indexing
Now that all your pages are ready to be added to search engine database, you can submit your website for indexing.
Here, you submit your site to search engines.
Why and when do you have to submit website to Google, Bing, Yahoo and others?
- When you have created a new website
- When you made major changes to your website
- When you created few or many new pages
- When you changes content or keyword focus, or both for one of more pages
- When you changed the internal structure or hierarchy of your website
- When you move your website to a new domain
- When some pages of your website are not indexed
These were few main reasons why you need to submit a site to search engines.
Now how to do it.
How to submit website to search engines for indexing
There are two types of submissions and two ways you can submit your web pages or website to Google and other search engines.
How to submit entire website
Submit robots file to Google
This is the first thing you should submit. This tells Google and other search engines that they are welcome to visit and crawl your website. You can also tell the spiders and bots of all search engines if you do not want them to crawl your site or certain pages in it.
Submit sitemap to Google
This is an XML sitemap which you submit to Google. This sitemap is written in plain text with no linking or hypertext. This also lists all your pages but as a simple plain list and is submitted to search engines to actually tell them to index all your listed pages.
Submit individual web pages for indexing or re-indexing
How to submit URL to Google and other search engines
Whenever you create a new page then you need to submit URL of the page to Google. You need to submit the new page to search engines for indexing. You should also do this when you make changes to a page. This change can be in the content or in meta tags or both.
What you need to do is submit that page URL separately to Google. Then also include that page in the XML sitemap and submit it again to Google and other search engines. Third, update your HTML sitemap, if you have it, and include the new page in it.
Keep site indexed by repeating the process
Keeping your website properly indexed and searchable is never a one time exercise. Time to time you need to check if your pages are indexed, searchable.
Here let us take a scenario
Imagine you start with a 10 page website and you take all the necessary steps to get it indexed and make it searchable. All your pages are well indexed and are readily searchable.
This means you are now good to make all these 10 pages rank on top Google and search engine pages and will achieve top page rankings too in certain period of time.
Then over a period of, let's say, one year you added 30 more pages and made small or major content, layout or structural changes to the some of the (let's say 5 pages) original pages too.
Now if you do not repeat the indexation and search engine submission process what happens then?
You have a total of 40 pages (10 original pages + 30 new pages). Good! The bad thing now. Out of these 40 pages only 5 pages are properly indexed in which you did not make any major changes. The rest (35 number) of the pages are either not indexed, or are indexed but not properly, and the 5 original pages might have gone little off the indexing radar.
Now out of the 40 page strong website, only 5 pages are indexed. Only these pages can be ranked on search engines for their relative keywords. This means only 12.5% of your entire website can be ranked.
The rest 87.5% of website with 35 pages will have too much difficulty in getting ranked or worst, these pages might not get ranked. These pages will not reach their targeted users, no matter how good your content on these 35 pages are, how thorough was your keyword research, and no matter how important these pages are for your website and your business.
That could be the biggest loss to any website when you are doing all the necessary other search engine optimization work.
So, to avoid this type of loss of search visibility and loss of rankings what you need to do is get your new website on Google and other major search engines like Bing and Yahoo, by way of submitting website and more. And you need to make sure that your site remains on there database.
One more important thing
There is one very important thing you could do before you submit your site and URLs to Google, Bing, Yahoo or other search engines. In fact you need to do this. Take a stock of your website host. Check if you have take hosting services from a good and reputed hosting provider. It's because if your site is down often then it will create problems in getting indexed and searched. Your rankings will get affected. And if everything else still goes smooth then your users will not be happy.
Worst thing is you may not always know if your site is down or not and when a searcher clicks on your site from and it is down then you are loosing much more than that current user.
Also make sure that you have taken a good and sufficient hosting plan which gives you enough of disk space and bandwidth.
Steps for site and URL Submission: Conclusion
The steps you need to submit entire site or URLs to search engines are summarized as follows:
For a new website
- Make your site ready
- Make sure all pages are reachable
- Make sure all page content readable
- Submit the entire site for indexing
- Submit robots file to Google
- Submit sitemap to Google
- Submit individual web pages for indexing or re-indexing
- Submit individual URLs to Google and other search engines
For changes in website
- Submit URL to Google, Bing and Yahoo
For new page (s) created
- Submit URL to Google, Bing and Yahoo
- Add URL to XML sitemap and submit sitemap to search engines
- Update and add new page to HTML sitemap
- Update your menu/navigation and footer menu or links with new page URL if you need to show it there