Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

In this Discussion

Setting Up New GSA Backup Drive

DeeeeeeeeDeeeeeeee the Americas
edited November 2019 in Other / Off Topic
My GSA Backup drive is running out of space.

So, I bought a SSD drive. Not a PCI NAND drive-stick, as speed is not essential for backups, and I'd rather have the enclosure to protect components. (I want to have my C on NAND tho; the extra spreed is worthwhile..at the very least need to connect PCI to SATA data...not as quick but still faster than just via SATA data port)

Anyway, it's a 1 TB drive. Not the fastest, but it's OK.

I am setting it up with NTFS file system.

I was thinking setting the block size to smallest may be good, as GSA has tons of tony files and this will save space in that the last block will not have as many empty bytes.

For a 1TB drive, I read that the default sector size is 4096 bytes. Should I set it instead to 512 K?

In the end, this won't give me that much more storage space.

If I have ~600,000 files associated with SER

AND

at most each file could shave 3584 kb

that would, at BEST (an impossible best, statistically, I'm sure due to varying file sizes)

2150400000 bytes

or

2150.4 MB

Is it worth it? I know it will slow down the drive.

To save 2 megs on a 1 TB drive seems ludicrious...

BTW,any other tweaks in setting that may help, would be appreciated.


Answers

  • DeeeeeeeeDeeeeeeee the Americas
    Oh, and that was 2 megabytes in an impossible scenario where all files end in the first quarter of the larger 4K block...

    So if ~ 1 in 4 blocks are this size (I see no reason why this could be skewed in ANY way)

    I'd only get 1/4  the saves, or about 512 KB savings.

    That seems even less hardly worth it!!! :| :| :|
  • DeeeeeeeeDeeeeeeee the Americas
    Going to put 12 hr backups (overwrites every 12 hrs)

    Daily backups (overwrites daily)

    And Weekly backups (overwrites weekly)

    And Monthly Archival backups (never overwrites)

    (I can later trash the archivals if they grow too numerous...as they will with time...)

    Just good to have all this...

    And of course, NOT on the same drive as the C: or any shared drives on physical C:



  • DeeeeeeeeDeeeeeeee the Americas
    edited November 2019
    Hmm...Wondering if it might make sense to set up the C: that GSA programs run on to have smallest block size...

    I mean after the program loads, it's just tons and tons of R/W to the drive....

    What about virtualizing the AppData file or putting on a  RAMdisk? Is it doable?

    And have it dump to a physical drive every X minutes??

    That seems like it might be faster for SER and other programs we use...
  • DeeeeeeeeDeeeeeeee the Americas
    "High Speed: The SATA III ports deliver a blistering fast data transfer speed of up to 6Gbps, letting you transfer monstrous amounts of data in seconds. They are also backward compatible with SATA I (1.5Gbps) and II (3Gbps) standards. "
    ht tps://www.am azon.c om/Ziyituod-Controller-Internal-Converter-Expansion/dp/B07R7V53ZC/

    So I can't get SATA drives to be any faster connected via PCI-E? :|:-1:

    Anyone know for sure?

    NAND via PCI-E:

    Data transfer rates up to 3500 MBps

    "For quick response when updating files."

    Seems like NAND is the way to go....for the boot, at least...
  • DeeeeeeeeDeeeeeeee the Americas
    edited November 2019
    OK I have it set up to be:

    AM Copy
    PM Copy
    Daily Copy (7)
    Weekly Copy (4)
    Monthly Copy (Archival)

    Only issue is, this may take a lot of time copying.

    But I'll have a lot of copies. :p :p :p :|

    The .BAT seems to work. We'll see.

    Now I have to make my work with GSA worth copying. hahaha  ;)
  • DeeeeeeeeDeeeeeeee the Americas
    And..of course, make backups from SSD to memory stick..

    haha whenever I say that or write that word I think of the Matt Cutts talk about KWs...
  • DeeeeeeeeDeeeeeeee the Americas
    Now if only I create some  projects worth backing up! :| :p
  • DeeeeeeeeDeeeeeeee the Americas
    Hmm..This is a lot of backing up.  :| My new 1TB SSD drive is going to fill up. :'(

    There's no way i have the space for all these backups! :(

    I can maybe make two distinct backup subroutines, one for APPDATA and one for PROGRAM files and only run the appdata backup once a day.

    More realistically,  I should check which files should have so many backups.

    And see where all the space is being taken up. I see it copying a lot of CAPTCHAs...?

    Maybe reduce it to only a 12 hour backup, a weekly backup, and a monthly??? hmmm

  • DeeeeeeeeDeeeeeeee the Americas
    edited November 2019
    Now    I have to make    my work with GSA    worth    copying.         hahaha 

    Now    if only I create    some  projects         worth     backing up!    p

    I swear this isn't an auto-gen account, ppl! :| :|

    I'm really just THAT repetitive... :|

    In any case, I must think this strongly...it's clearly on my mind!
Sign In or Register to comment.