Extra 'Stuff' In URL
11:45:26: [+] 817/2634 possible new Target URLs from General Blogs -
Sometimes I get URLs like that. The male+enhancement+pills and nofollow part is unnecessary, and it makes it look messy.
Not really affecting performance, but I'm wondering why it's like that. I'm only using Google as a search engine and I'm using 500 private proxies to scrape.
Thanks.
Sometimes I get URLs like that. The male+enhancement+pills and nofollow part is unnecessary, and it makes it look messy.
Not really affecting performance, but I'm wondering why it's like that. I'm only using Google as a search engine and I'm using 500 private proxies to scrape.
Thanks.
Comments