Changes

Jump to: navigation, search

Data Transfer

69 bytes added, 09:34, 9 September 2016
A script runs daily on astro.suth, and pulls recent data from all the instruments of which it is aware. At the moment, this includes shocnawe, shocndisbelief and SpUpNIC, but we will be adding more instruments as we have the opportunity. We are also configuring a version of this script to run on astro.cape, after the astro.suth script has completed; this will synchronize data between Sutherland and Cape Town. There should then be two back-ups of the data on each instrument.
By default, the The script runs is run daily at 08:00 AM from a cron job, but can also be run manually. The script synchronizes data from It is possible to specify a specific date to synchronize (-d option), as well as a specific instrument (-i option). One can also specify the last N number of past days, where N (counting back from today) for which the data is specified by synchronized (the user-n option). The  By default value is the last 30days are synchronized; this should ensure that if data is not copied on some particular day, it will be copied on a later day. If the instrument is unmounted before the scheduled sync time, or data is acquired after the sync but before unmounting, then this might lead to data not being immediately copied for that day. If the machine is off for more than 30 days (as currently configured), then a manual sync should be done after the instrument is remounted.
It is possible to specify a specific date to synchronize (-d option), as well as a specific instrument (-i option).
On astro.suth the data is stored under /data/telescopedata. The path to the data then takes the form <telescope>/<inst>/<YYYY>/<MMDD>/. Here the telescope can be one of 74in, 40in or 1m, and the inst is the abbreviated instrument name (one od sha, shd or spupnic). So for example, data acquired by shocnawe on the 74-inch telescope on the night of the 8th/9th of September, 2016, would be in/data/telescopedata/74in/sha/2016/0908. Note: the data is archived on the astro servers using this standard SAAO/SALT data path; some instruments may not yet use this exact directory structure for local (on-instrument) data storage.
Carel
187
edits
Retrieved from "https://topswiki.saao.ac.za/index.php/Special:MobileDiff/1375"