Kundra
Be a part of Nullsto's Growth ;)
Staff member
Moderator
Nullsto Lover
GiveAway Master
Trusted Uploader
- Joined
- Sep 16, 2022
- Messages
- 3,856
- Reaction score
- 5,980
- Points
- 193
If you are familiar with indexing services and you see recently they don't work sometimes. In this post, I will explain how the indexers work and why they don't work well at the moment, and also how to build your own indexers.
There are numerous ways that indexers on the market work that is also a mystery to you. Admittedly that even their indexers are not working now but if they used to work, they are very good though. Below are few methods of building an indexing service.
1. How do indexers work?
Forget all the old methods like pinging and create link redirections, URL shorten.... My post only mentions modern methods.
1.1 Using the guestbooks, blog comments.
With this method, they just spam your backlinks to many guestbook platforms where user can leave the comment. These sites have a good indexing rate and have good traffic, your links then will be indexed fast. This kind of indexer works in 2016-2017.
1.2. Using Google indexing API and PBNs.
Google has an API for indexing for your own site, it allows you to request an increased indexing rate daily to your page. Imagine that instead of submitting your URLs to the Search Console, you can use the API to request google bots to crawl your new pages/posts.
The indexing services simply just submit your backlinks to their site in 1 post, then use google indexing API to request the bots to crawl that post. And they do this in mass, I mean, they have a system that can do this automatically so they can handle many request a day.
1.3. Using Google properties
Google properties are favored by Google in terms of crawling rates. If you create your blogger, google sites, even gg docs (then you can publish it as a web page), then you will have your backlinks indexed fast. Few indexers use this method, it used to work.
2. Why indexers don't work sometimes, or It used to work then stop working?
I used to use many indexing services and got frustrated when they are not working. Then I came up with my research and testing. Then created indexers myself. My indexers had the same fate as other indexers, that how I know why indexers just stop working somtimes.
2.1. Google updates the algorithm.
This happens all the time, index algorithm changes make the indexers become outdated.
2.2. Google blacklists the sites
Google knows if you index your backlinks by spamming. When it knows the crawling budget to your site is decreased or even worst, deindexed.
2.3. Google has trouble itself
It costs google resources to crawling and indexing multi-billion pages on the internet. And sometimes in a short period, it runs out of resources.
2.4 It also depends on the quality of your backlinks
It's true that quality backlinks with unique, useful content will get index faster. Good can read your content now using their AI called BERT.
3. How to build your own indexer.
It's important to build your own indexers that work because you cannot fully rely on indexing services. Before going to building an indexer. We should answer the question: which kind of site google likes to crawl and index. the answers are:
Google likes/forced to CRAWL this kind of sites:
- New fresh domains
- Domains that have traffic, even referral traffics count.
- Domains that ask for google to crawl
- Sites that ask google for approval on google's service (search console, google news, Adsense)
- Sites that have servers that can handle huge crawling budget
- Sites that have content update frequently
Google likes INDEX this kind of sites:
- Sites that have good content. (copied, scraped content still get indexed)
- Sites that are google news approved
- Sites that have Adsense
- Sites that have traffic and backlinks..
There are many more, but I think it's enough for now. You can build your own indexer following the step below.
STEP 1: Creating a PBN (if you don't have much budget) or PBNs
Setting up WordPress PBNs is easy, I know most of you can do it.
STEP 2: Do auto-content
Using WordPress automatic plugin to generate content from another source, you will figure it out how to get 200-1000 fresh article a day. Translation will be highly recommended.
If you need my instruction to set this up, please comment below.
I will call this site is PBN1
This site over time will have traffics, and also can have Adsense approval. It also will get new articles indexed everyday.
STEP 3: Submit your backlinks into posts
There is a plugin called WordPress all import, this plugin helps your import articles to your WordPress site. This is what I do
I have an extra wp site (called PBN2 which I don't allow google bot to crawl) that also use WordPress automatic to scrape article every day, I use WordPress all export to export those articles into csv. The format will be like:
|title|Article content|
Now I and 1 more column called backlinks. and one
|title|Article content|Backlinks|URLs
You will paste the links you want to index to Backlink column. Can be 2-20 links a row
URLs is the new post URLs when you submit this new csv file into your PBN1. This can be generated from the title column.
Now, you import this csv file to PBN1. using this setting
Title: {title[1]}
Content:
{Article content[1]}
{Backlinks[1]}
That means each article published from this CSV file will have a few backlinks at the bottom.
STEP4: Submit your URL using Google indexing API.
Install Rank Math, then set up the Instant indexing. This help you bulk submit your URLs to google (like you do in search console but in bulk)
Copy the URLs in the URLs column of the CSV file then submit it to indexed.
Additional: Contently submit for Adsense and Google News approval
When you do it, google forced to crawl your site too.
P/S: I Tested many methods and currently doing this, but I have my own system with 30 PBN sites and not using WordPress. Above is just the basic idea of doing an indexer. Many of you guys are talented, you can create your own system using this method.
Some unique, secret ways of doing the method above you have to find out yourself. I have to keep something for myself. Thanks for reading and if you have any question just tell me.
There are numerous ways that indexers on the market work that is also a mystery to you. Admittedly that even their indexers are not working now but if they used to work, they are very good though. Below are few methods of building an indexing service.
1. How do indexers work?
Forget all the old methods like pinging and create link redirections, URL shorten.... My post only mentions modern methods.
1.1 Using the guestbooks, blog comments.
With this method, they just spam your backlinks to many guestbook platforms where user can leave the comment. These sites have a good indexing rate and have good traffic, your links then will be indexed fast. This kind of indexer works in 2016-2017.
1.2. Using Google indexing API and PBNs.
Google has an API for indexing for your own site, it allows you to request an increased indexing rate daily to your page. Imagine that instead of submitting your URLs to the Search Console, you can use the API to request google bots to crawl your new pages/posts.
The indexing services simply just submit your backlinks to their site in 1 post, then use google indexing API to request the bots to crawl that post. And they do this in mass, I mean, they have a system that can do this automatically so they can handle many request a day.
1.3. Using Google properties
Google properties are favored by Google in terms of crawling rates. If you create your blogger, google sites, even gg docs (then you can publish it as a web page), then you will have your backlinks indexed fast. Few indexers use this method, it used to work.
2. Why indexers don't work sometimes, or It used to work then stop working?
I used to use many indexing services and got frustrated when they are not working. Then I came up with my research and testing. Then created indexers myself. My indexers had the same fate as other indexers, that how I know why indexers just stop working somtimes.
2.1. Google updates the algorithm.
This happens all the time, index algorithm changes make the indexers become outdated.
2.2. Google blacklists the sites
Google knows if you index your backlinks by spamming. When it knows the crawling budget to your site is decreased or even worst, deindexed.
2.3. Google has trouble itself
It costs google resources to crawling and indexing multi-billion pages on the internet. And sometimes in a short period, it runs out of resources.
2.4 It also depends on the quality of your backlinks
It's true that quality backlinks with unique, useful content will get index faster. Good can read your content now using their AI called BERT.
3. How to build your own indexer.
It's important to build your own indexers that work because you cannot fully rely on indexing services. Before going to building an indexer. We should answer the question: which kind of site google likes to crawl and index. the answers are:
Google likes/forced to CRAWL this kind of sites:
- New fresh domains
- Domains that have traffic, even referral traffics count.
- Domains that ask for google to crawl
- Sites that ask google for approval on google's service (search console, google news, Adsense)
- Sites that have servers that can handle huge crawling budget
- Sites that have content update frequently
Google likes INDEX this kind of sites:
- Sites that have good content. (copied, scraped content still get indexed)
- Sites that are google news approved
- Sites that have Adsense
- Sites that have traffic and backlinks..
There are many more, but I think it's enough for now. You can build your own indexer following the step below.
STEP 1: Creating a PBN (if you don't have much budget) or PBNs
Setting up WordPress PBNs is easy, I know most of you can do it.
STEP 2: Do auto-content
Using WordPress automatic plugin to generate content from another source, you will figure it out how to get 200-1000 fresh article a day. Translation will be highly recommended.
If you need my instruction to set this up, please comment below.
I will call this site is PBN1
This site over time will have traffics, and also can have Adsense approval. It also will get new articles indexed everyday.
STEP 3: Submit your backlinks into posts
There is a plugin called WordPress all import, this plugin helps your import articles to your WordPress site. This is what I do
I have an extra wp site (called PBN2 which I don't allow google bot to crawl) that also use WordPress automatic to scrape article every day, I use WordPress all export to export those articles into csv. The format will be like:
|title|Article content|
Now I and 1 more column called backlinks. and one
|title|Article content|Backlinks|URLs
You will paste the links you want to index to Backlink column. Can be 2-20 links a row
URLs is the new post URLs when you submit this new csv file into your PBN1. This can be generated from the title column.
Now, you import this csv file to PBN1. using this setting
Title: {title[1]}
Content:
{Article content[1]}
{Backlinks[1]}
That means each article published from this CSV file will have a few backlinks at the bottom.
STEP4: Submit your URL using Google indexing API.
Install Rank Math, then set up the Instant indexing. This help you bulk submit your URLs to google (like you do in search console but in bulk)
Copy the URLs in the URLs column of the CSV file then submit it to indexed.
Additional: Contently submit for Adsense and Google News approval
When you do it, google forced to crawl your site too.
P/S: I Tested many methods and currently doing this, but I have my own system with 30 PBN sites and not using WordPress. Above is just the basic idea of doing an indexer. Many of you guys are talented, you can create your own system using this method.
Some unique, secret ways of doing the method above you have to find out yourself. I have to keep something for myself. Thanks for reading and if you have any question just tell me.