Follow internal link

Kaine · October 2015

Hi @sven

How i can make proxy scraper grab proxy here: http://www.freeproxylists.com/elite.html

Url in is like that:

http://www.freeproxylists.com/elite/1445356301.html

http://www.freeproxylists.com/elite/1445347304.html ...

Surely hash or other but think is not static url.

Or for follow all link ?

Sven · October 2015

Tried that but it is protected by javascript. At least I didn't figure out how the content is loaded.

Kaine · October 2015

Maybe is possible to follow all link on X level ?

Edit: or this is that is blocked by java ?

cherub · October 2015

Just change the url from say

http://www.freeproxylists.com/elite/1445356301.html

to

http://www.freeproxylists.com/load_elite_1445356301.html

and you can extract from there

Kaine · October 2015

Thank you cherub but no says if i can save that like source. 1445356301 is surely randomized for block scrape ... Or news url with alive proxy is generated like that but not sur.

I just start with this soft and must see how it work like for mask option.

Sven · October 2015

@cherub thanks, will be added in next update

Kaine · October 2015

Thank You @sven @cherub

Follow internal link

Comments