Extra 'Stuff' In URL

11:45:26: [+] 817/2634 possible new Target URLs from General Blogs -

Sometimes I get URLs like that. The male+enhancement+pills and nofollow part is unnecessary, and it makes it look messy.

Not really affecting performance, but I'm wondering why it's like that. I'm only using Google as a search engine and I'm using 500 private proxies to scrape.

Thanks.

Comments

  • SvenSven www.GSA-Online.de
    Accepted Answer
    have a look on the verified urls from that project. Some might be wrong in there.
Sign In or Register to comment.