Skip to content

maximum number of threads per project?

@Sven i have been running 1000 threads for a scraping project and please note, just scraping but i discovered that the threads running did not go beyond 536,please i would like to know how why it did not use up to the amount of threads i configured in the settings ,as i would like to scrape for websites faster atleast.
Thanks
Tagged:

Comments

  • SvenSven www.GSA-Online.de
    Keep in mind that it is having to wait between search queries to not get your IP banned. If you want to increase the speed, you need to use proxies.
  • thanks
Sign In or Register to comment.