2024-02-20, 06:44 PM
There's no way around this. If you want to have a 1-1 backup of your libraries, you need to obtain disks with enough capacity to hold all of your data. So if you have a library that's 50TB in total, you will need to buy enough disks to equal 50TB in the backup location.
You can try to compress your library to shrink its size by a percent, but this will be extremely slow, and video do not compress well.
And when it's time to restore from a compressed backup, you need to decompress it before adding it back to your main server.
If you backup your libraries with something like rsync, only the initial backup will take the longest. Each future rsync to the backup source will be way faster as it only needs to send data for new files or files that were modified.
To figure out how long the initial transfer will take, you need to find the max data transfer rate between your main server and the backup server. If both are connected with a 1Gbps link, that's ~117MB/s. So get the total size of your library in MB, then divide it by 117 to get the total seconds (keep in mind that this is not taking into account transfer rate dips, your just finding out what the fastest a transfer could be under ideal conditions).
You can try to compress your library to shrink its size by a percent, but this will be extremely slow, and video do not compress well.
And when it's time to restore from a compressed backup, you need to decompress it before adding it back to your main server.
If you backup your libraries with something like rsync, only the initial backup will take the longest. Each future rsync to the backup source will be way faster as it only needs to send data for new files or files that were modified.
To figure out how long the initial transfer will take, you need to find the max data transfer rate between your main server and the backup server. If both are connected with a 1Gbps link, that's ~117MB/s. So get the total size of your library in MB, then divide it by 117 to get the total seconds (keep in mind that this is not taking into account transfer rate dips, your just finding out what the fastest a transfer could be under ideal conditions).