filmov
tv
DomCop Guru Plan - Expired Domains Crawler
Показать описание
In this video you will learn everything you need to get the most of the DomCop Guru plan. If you have not already watched the two videos on How to use the Newbie Plan and the Power Plan, please pause this one right now, click on the links below, watch both those videos and then come back as this one as will only talk about the features that exist in the Guru Plan that are not there in the Newbie & Power plans.
The Guru Plan gives you access to our personal expired domains crawler. Using this crawler you can scrape any website online. The crawler will find all broken links from that website and figure out if the domain it points to is available to purchase. If an available domain is found this way, the crawler will get all the metrics for the domain and show it in your crawler section. Note that unlike the Expiring, Expired and Archive sections, domains that are shown in the Crawler section are only shown to you, because your crawlers found these domains only for you.
To start using the Personal expired domain crawler, you need to setup a crawl job. This basically tells the crawlers which websites are to be crawled along with different settings that tells the crawler how to do its job.
There are four types of Crawl Jobs that you can create
1. Complete Website Crawl
The complete website crawl job is the most basic type of job. This job assumes you have a list of websites that you would like to crawl.
2. Keyword Search Crawl
In a Keyword Search crawl, you can specify a list of keywords you want to target. The crawler will scrape Google for those keywords and create a list of websites from the top 10/20 results shown. You can specify whether the results are to be shown for a specific country, language or based on certain date (e.g. all results from 1998)
Internally once the crawler creates a list of websites from scraping Google, this crawl job will work exactly the same as the Website crawl job.
3. Reverse Website Crawl Job
In a Reverse Website Search crawl, you specify a list of competitor websites. The crawler will find all the backlinks to those websites create a massive list of all websites linking to your competitors.
Once again, like the Keyword Search Crawl job, internally once the crawler creates a list of websites that link to your competitor, this crawl job will work exactly the same as the Website crawl job.
4. Niche Website Crawl Job
This is a good option for those who don’t have a list of websites, competitors, or keywords, and want to get started finding domains in a specific niche. At DomCop we maintain a large set of websites categorized by separate niches and which have a high Majestic Trust Flow and Moz Domain Authority.
When you select a niche in the Niche website crawl job, the crawler picks up a number of websites from our maintained list and starts crawling them. These are websites that are in the niche you specified and have high Majestic and Moz metrics.
Once you’ve created a crawl job, your crawlers will immediately start working on it. One important thing to note is that each crawler can only crawl one website at a time. So if you have purchased the largest Guru Plan package with 50 crawlers, you should have at least 50 websites that can be crawled simultaneously. There are no limits on the number of crawl jobs you can create. Many of our Guru Plan III customers create a dozen or so jobs, each with a few hundred websites and then let the 50 crawlers work on them.
As the crawlers find domains, you will start seeing them appear in the Crawler section. These domains will initially show an “clock” icon in place of metrics, as the metrics are pulled only once a domain is found to be available. However, in a few minutes, you should start seeing all the metrics for these domains as well.
The Guru Plan gives you access to our personal expired domains crawler. Using this crawler you can scrape any website online. The crawler will find all broken links from that website and figure out if the domain it points to is available to purchase. If an available domain is found this way, the crawler will get all the metrics for the domain and show it in your crawler section. Note that unlike the Expiring, Expired and Archive sections, domains that are shown in the Crawler section are only shown to you, because your crawlers found these domains only for you.
To start using the Personal expired domain crawler, you need to setup a crawl job. This basically tells the crawlers which websites are to be crawled along with different settings that tells the crawler how to do its job.
There are four types of Crawl Jobs that you can create
1. Complete Website Crawl
The complete website crawl job is the most basic type of job. This job assumes you have a list of websites that you would like to crawl.
2. Keyword Search Crawl
In a Keyword Search crawl, you can specify a list of keywords you want to target. The crawler will scrape Google for those keywords and create a list of websites from the top 10/20 results shown. You can specify whether the results are to be shown for a specific country, language or based on certain date (e.g. all results from 1998)
Internally once the crawler creates a list of websites from scraping Google, this crawl job will work exactly the same as the Website crawl job.
3. Reverse Website Crawl Job
In a Reverse Website Search crawl, you specify a list of competitor websites. The crawler will find all the backlinks to those websites create a massive list of all websites linking to your competitors.
Once again, like the Keyword Search Crawl job, internally once the crawler creates a list of websites that link to your competitor, this crawl job will work exactly the same as the Website crawl job.
4. Niche Website Crawl Job
This is a good option for those who don’t have a list of websites, competitors, or keywords, and want to get started finding domains in a specific niche. At DomCop we maintain a large set of websites categorized by separate niches and which have a high Majestic Trust Flow and Moz Domain Authority.
When you select a niche in the Niche website crawl job, the crawler picks up a number of websites from our maintained list and starts crawling them. These are websites that are in the niche you specified and have high Majestic and Moz metrics.
Once you’ve created a crawl job, your crawlers will immediately start working on it. One important thing to note is that each crawler can only crawl one website at a time. So if you have purchased the largest Guru Plan package with 50 crawlers, you should have at least 50 websites that can be crawled simultaneously. There are no limits on the number of crawl jobs you can create. Many of our Guru Plan III customers create a dozen or so jobs, each with a few hundred websites and then let the 50 crawlers work on them.
As the crawlers find domains, you will start seeing them appear in the Crawler section. These domains will initially show an “clock” icon in place of metrics, as the metrics are pulled only once a domain is found to be available. However, in a few minutes, you should start seeing all the metrics for these domains as well.
0:09:43
0:09:36
0:15:01
0:00:53
0:07:09
0:06:33
0:03:27
0:04:50
0:06:51
0:07:53
0:00:32
0:18:46
0:21:37
0:07:51
0:46:28
0:01:31
0:50:54
0:01:47
0:00:37
0:06:05
0:15:58
0:02:09
0:05:01
0:04:21