Skip to content

I scrape 1m list but gsa keep crash when i import it.

awintawint
edited September 2012 in Feature Requests
i split to 100 files, each only 200k in size. but gsa still crashed. it say, 'continue', 'stop', 'restart'  it pop this windows again when click continue button.  please advice.  i sent the bug report already. thanks.

Comments

  • BytefakerBytefaker
    I think you should send Sven the list too. Otherwise it's hard to reproduce. I had such crashes too in the past, but after a restart of SER I was able to import the list without any problems.
  • SvenSven www.GSA-Online.de
    next version will take less resources for site list parsing from files
  • s4nt0ss4nt0s Houston, Texas
    That's odd. I've imported 450,000 keywords into the software without any issues. I was surprised at how well it handled the large list. :)
  • SvenSven www.GSA-Online.de
    Oh it's about keywords? I though this is about site lists import. Well on the keyword part there is nothing I can improve really.
  • s4nt0ss4nt0s Houston, Texas
    No he is talking about the site lists. I was just mentioning I've imported a large lists of keywords without issues. I didn't realize they handled things differently.
  • awintawint
    so it is not about size. it is about site list.  site list contain bad url will cause crash?
  • SvenSven www.GSA-Online.de
    No, it will just skip wrong urls (have to start with http:// or https://.
  • awintawint
    so can you quickly fix the crash problem?  if it ignore, it should not crash just slow.
  • SvenSven www.GSA-Online.de
    edited September 2012
    It's still crashing after 4.30 ? Because in that version it should no longer do this. Else please provide the file you import and it crashes.
  • awintawint

    i limit the thread to 800 all are fine

  • SvenSven www.GSA-Online.de
    wow 800 threads and its still stable? I would expect that memory usage is almost on the 2.1gb limit. How much is used?
Sign In or Register to comment.