BackupsMSL: verschil tussen versies

Uit MakerSpace Leiden
Ga naar: navigatie, zoeken
(deur-db 192.168.4.2)
(deur-db 192.168.4.2)
Regel 48: Regel 48:
 
which does an incremental backup (rsync) of all mounted EXT4 volumes - excluding the devices:
 
which does an incremental backup (rsync) of all mounted EXT4 volumes - excluding the devices:
  
  #!/bin/sh
+
#!/bin/sh
  mount -t ext4 | awk '{print  $3 }' | while read dir
+
echo Backup:
   do
+
E=0
rsync -xCaz $dir --exclude '/proc/**' --exclude '/dev/**' --exclude '/sys/**' backup-msl:/usr/home/backup-msl/msl-deurdb
+
mount -t ext4 | awk '{print  $3 }' | while read dir
  done
+
do
 +
        echo -n "   $dir: "
 +
        rsync -xCaz $dir --exclude '/proc/**' --exclude '/dev/**' --exclude '/sys/**' backup-msl:/usr/home/backup-msl/msl-deurdb && echo OK || E=$?
 +
done
 +
exit $E
  
 
This is called by crontab:
 
This is called by crontab:

Versie van 22 feb 2018 om 18:13

Backup setup (temporary).

Common setup

A pub/private keypair; with a blind, incremental rsync over ssh.

It relies on

 .ssh/config
 .ssh/id_rsa

for its config and data.

main host 192.168.5.1

File in

/usr/local/etc/periodic/daily/999.backup

which does an incremental backup (rsync) of all mounted UFS volumes.

#!/bin/sh
E=0
echo Offsite backups:
mount -p -t ufs | awk '{print  $2 }' | while read dir
do
        /bin/echo -n "  $dir:"
        if rsync -xCaz $dir --exclude "**/dev/**" backup-msl:/usr/home/backup-msl/msl-main; then
               echo OK - completed without error.
        else
                E=$?
                echo failed.
        fi
done
echo
exit $E


scheduling, capturing the output, logging and email-alerts are all handled as per periodic(8)[1].

deur-db 192.168.4.2

File in

 /home/mvn/backup.sh

which does an incremental backup (rsync) of all mounted EXT4 volumes - excluding the devices:

#!/bin/sh
echo Backup:
E=0
mount -t ext4 | awk '{print  $3 }' | while read dir
do
        echo -n "   $dir: "
        rsync -xCaz $dir --exclude '/proc/**' --exclude '/dev/**' --exclude '/sys/**' backup-msl:/usr/home/backup-msl/msl-deurdb && echo OK || E=$? 
done
exit $E

This is called by crontab:

 MAILTO=xxx@xxxx.com
 0 3 * * * test -x /home/mvn/backup.sh && /home/mvn/backup.sh > /var/log/backup.log 2&>1

with a quick sentinel and we're keeping a log of the most recent backups. In order for the email to work - outbound ssmtpd was configured in /etc/ssmtp/ssmtpd.conf as:

FromLineOverride=YES
mailhub=smtp.xs4all.nl
UseSTARTTLS=YES
hostname=makerspaceleiden.nl
root=postmaster

Destination

On the destination server:

 command="/usr/local/bin/rsync --server  -logDtprCze.iLsfxC . backup-msl/msl-main",,restrict,no-agent-forwarding,no-port-forwarding,no-pty,no-user-rc,no-X11-forwarding ssh-rsa ....

backed by an encrypted FS with a daily zfs-snapshot post the backup run; which ultimately gets offloaded onto tape. The rentention policy is currently 5 years (to be adjusted).