Skip to content

GSA hanging on importing sites from sitelist

LeeGLeeG Eating your first bourne
edited December 2012 in Need Help

Had this intermittent error start from version 4.76

When importing sites from site list it can just hang

Cpu at zero %

Threads at 291

Sven, there will be an email with the error report from an earlier crash in your email

2nd time today

Comments

  • SvenSven www.GSA-Online.de
    yes got it but still not sure what this is causing...will check on monday. Maybe you can provide the file you try to import?
  • LeeGLeeG Eating your first bourne

    Thanks for getting back Sven

    My mistake for the description of the error, its when its loading sites from the site list

    I reset the vps, complete reboot at midnight, that way there are no memory issues etc.

    Straight run with nothing more than GSA and CSX running on the vps

    This has only started happening since version 4.76

    The two error email sent through today, both have screen shots attached

    This is one of the resource manager to show the state of gsa at the time

    image

     

    And how I found gsa at the time of the above

    image

    It happed again two hours after resetting gsa today

  • SvenSven www.GSA-Online.de
    i will try to improve this. though you seem to be the only one with this issue and I couldn't loacte anything bad on the bugreport itself either.
  • LeeGLeeG Eating your first bourne

    I cleared all the duplicate urls from the sitelists last night to see if it makes any difference

    Something I do once or twice a week. Over a million duplicates cleared last night

     

    It sounds like someone else has reported a similar fault

    https://forum.gsa-online.de/discussion/1202/not-sure-what-but-after-latest-2-updates-gsa-keeps-crashing-and-not-responding#Item_2

  • SvenSven www.GSA-Online.de
    Can you try to run it in compatibility mode to WinXP? I made some tweaks in the new versions that might have an influence on 64bit systems.
  • LeeGLeeG Eating your first bourne

    Its not crashed since midnight when I cleared the duplicate urls.

    First time since Thursday it done a straight run without crashing.

    Im monitoring the memory at the moment, soon as it hits a low level, I will reboot the vps and kick it into XP mode

    17.5hr straight run and just shy of being back in the 40k submissions club at the moment

    Intermittent faults are the worst to find on a good day anyway.

  • LeeGLeeG Eating your first bourne

    This what I mean by the 40k club

    image

  • ronron SERLists.com
    @LeeG - Showoff :)
  • LeeGLeeG Eating your first bourne

    Moi is innocent. Honest

    Not hit the 60k club for a few days due the intermittent crashes

    Each crash has reset the counters to zero

    Hopefully its just the bottom counters that lost their data rather than the site submissions being added to each project

    My ultimate goal is to see if the bottom counter with the s in it, breaks at 6 digits :D

    No doubt that will need a bit more Sven magic with the release of his decaptcha software

    From my next vps reset when memory gets low, it crashes or it hits midnight here, I will be running gsa in xp mode.

    Im still waiting for it to crash again, take a screen shot so there is some idea behind whats going on when it goes down. Sods law as soon as the errors are reported after multiple crashes, it wont do it again

     

     

  • Sven is it true that you're working on your own decaptcha software ? I did not knew this and would be a nice addition :)
  • SvenSven www.GSA-Online.de
    yes, and it will see the public soon don't worry ;)
  • LeeGLeeG Eating your first bourne

    Im out to see if that bottom counter breaks when it hits 6 digits

    Half way there most days at present

     

    Back to the reported problem

    The only thing I have done apart from add a few more search engines was clear the duplicates from the site lists. GSA also did a straight 24hr run with no low memory warnings, something which I normally hit about 18hrs into a straight run. hence why I normally do a gsa reset and vps reboot every 12hrs

    Its the first day since Thursday without any crashes

     

    My GSA is now running in xp compatible mode to see how it goes

     

    And just to wind Ron up, the picture of todays run

     

    image

  • ronron SERLists.com
    edited December 2012
    That's just so unfair :P
  • LeeGLeeG Eating your first bourne

    Bug report sent from GSA Sven

    Crashed again over night

    These are screen shots from how I found it today

    image

    Forgot the time that was taken waas 11:30am

     

    And the state GSA was in under the resource manager

    image

     

  • LeeGLeeG Eating your first bourne

    And again. With another error report email sent throuugh. A couple more screen shots if it helps

     

    Memory usage

    image

     

    General state

    image

     

    What it was doing when it crashed

    image

     

     

     

  • SvenSven www.GSA-Online.de
    next version should fix this.
  • LeeGLeeG Eating your first bourne

    Thanks Sven

     

  • LeeGLeeG Eating your first bourne

    Bad news, just had GSA crash again.

    Similar to all the above with cpu sat at zero

    Managed to get it to create and send a report through Sven

    Its run all day, then just sat there doing nothing. Which in todays case is just shy of 50K links submitted

  • SvenSven www.GSA-Online.de
    this should be fixed as noone complained about it anymore ;)
  • AlexRAlexR Cape Town
    edited March 2013
    It crashed on my one VPS but not the others. Not sure the cause. I think the reduce threads if not enough resources may not be working. The reason I'd guess (I'm not a programmer, so it would be a guess), is that if I increase the thread number on my other VPS, SER crashes. So I'd guess it's somehow not throttling back if there are not enough resources. OR there is a resource spike and it crashes...
Sign In or Register to comment.