Checking metrics after successful identification?
muchcontent
Europe
I just bought platform identifier and proxy scraper. So I'm trying to emulate PR when identifying a list in platform identifier using majestic metrics. I started with 300 proxies that was good for majestic checking, but with default threads 100 of them burned out in 3 min. So I've set the thread count for this project in platform identifier to 10, which will complete the project of about 1 million URLs in about a month. Proxies are still slowly decreasing though. So I have a few questions about this:
1. Does platform identifier check for majestic metrics before or after the URL has been identified with a platform? If the answer is before, is there a way for me to make the metric filtering process start after the URL has been identified in order to save proxies from burning out? Because there is no use getting metrics for URLs which will not be used anyway.
2. I'm getting a lot of error messages in proxy scraper during the metric checking. What happens when it fails to retrieve metrics for a URL and a PR-filter is set in platform identifier? Will the URL be discarded?
3. Is there any way to increase the speed of this whole process without buying 500 private proxies?
4. Is 15% a normal amount of recognized/identified links from a footprint scraped list?
1. Does platform identifier check for majestic metrics before or after the URL has been identified with a platform? If the answer is before, is there a way for me to make the metric filtering process start after the URL has been identified in order to save proxies from burning out? Because there is no use getting metrics for URLs which will not be used anyway.
2. I'm getting a lot of error messages in proxy scraper during the metric checking. What happens when it fails to retrieve metrics for a URL and a PR-filter is set in platform identifier? Will the URL be discarded?
3. Is there any way to increase the speed of this whole process without buying 500 private proxies?
4. Is 15% a normal amount of recognized/identified links from a footprint scraped list?
Comments