Verification
There's a script that runs daily at 9:00 to confirm that all data have been copied from the instruments onto astro.suth and astro.cape. The script can be viewed here while logged into Bitbucket.
How it works
This requires Paramiko, is currently configured inside of my home directory on astro2015.cape.saao.ac.za at /home/briehan/check_data.py and works by checking for the existence of fits files inside of the directories for this month and last month.
The crontab for my user:
MAILTO=briehan@saao.ac.za,amanda@saao.ac.za,carel@saao.ac.za 0 9 * * * /home/briehan/venv/bin/python /home/briehan/checkdata.py
Example output
An example of the output generated by the script is included below:
/data/74in/sha/ -------------------------------------------------------------------------------- FILES ON sha.suth.saao.ac.za THAT ARE NOT ON astro.suth.saao.ac.za -------------------------------------------------------------------------------- 2016/0907/SHA_20160907.0122.fits 2016/0907/SHA_20160907.0123.fits 2016/0907/SHA_20160907.0124.fits 2016/0907/SHA_20160907.0125.fits 2016/0907/SHA_20160907.0126.fits 2016/0907/SHA_20160907.0127.fits 2016/0907/SHA_20160907.0128.fits