Skip to content

How To Edit .dat Files

AlexRAlexR Cape Town
in GSA Website Contact
Hi

I have a 250mb .dat file.

It has success & failed urls in it and I'd like to sort it.

I want to create some sub files
1) success
2) Error - Captcha Error
3) Error - No Contact Links
4) Error - No Contact Form

(I have this needed for a few files!)

I'm really struggling as Excel crashes. Any ideas on how to do this?

Comments

  • SvenSven www.GSA-Online.de
    Use PsPAD or Notepad++ ...then search in the opened file for "no contact form" and click "Copy" (PsPad).

    Then you will have a file with just that of a status.

    But it might be more easy if you export the data directly from the program in CSV format and load it into your favorite Excel-Like tool.
  • AlexRAlexR Cape Town
    What I'm trying to is simply sort some stuff.

    1) PSPpad has weird formatting. https://www.screencast.com/t/SZuH5Gq9
    2) Notepad ++ crashes on a 45mb file with search for feature.
    3) Excel is unusable. It's too much data.

    Is there no way for the snd+exp+del feature we could have just URL lists
     (no dates & other data that makes the file massive)
    and it saves a txt for:
    1) Success
    2) Failed - Captcha Error
    3) Failed - No Contact Form
    4) Failed - No Contact Links
    5) Filtered
    It would be much easier than trying to work through these massive .dat  files or the current files that have all the extra data we don't need.
  • SvenSven www.GSA-Online.de
    1) You opened thatin HEY Editor Mode...open it in normal with right click on the file.
    2) Can't judge...Im a PsPad fanboy
    --
    If it's all too much data, simply select based on your criteria in tools and export selected only....repeat for another status message.
  • AlexRAlexR Cape Town
    1) In PSPAD is there a way to copy the actual success urls? E.g. only col 4.

    2) 
    If it's all too much data, simply select based on your criteria in tools and export selected only....repeat for another status message.
    The reason I have to edit .dats and stuff is it keeps crashing badly when I try anything like that. Even removing filtereds from a projects crashes it.

    All I'm trying to do is extract url groups (success, failed, filtered) etc. so I can use on other projects.

  • AlexRAlexR Cape Town
    3) Here's what I mean about extra data.
    https://www.screencast.com/t/HIhxHpRin9G
    - 26mb swells up 5X to 109mb. 
    when all we need is the URLS.  It also takes ages (for me) trying to extract just the urls. (Still trying to work it out)


  • SvenSven www.GSA-Online.de
    1) Yes, simply search for one string thats only part of that line and instead of OK click COPY on the search dialog.
  • AlexRAlexR Cape Town
    Thanks.
Sign In or Register to comment.