Changes

Jump to: navigation, search

SHOC

1,917 bytes added, 14:05, 28 July 2015
/* Data Transfer */
===Data Transfer===
* To transfer data directly to your computer from the SHOC instrument, use the command line. Copy the data using the following command, depending on the telescope:
rsync -avzP shoc74in@shoc74in.suth.saao.ac.za:/data/74in/sh?/<YYYY>/<MMDD>/*.fits /LocalFilePath
rsync -avzP shoc40in@shoc40in.suth.saao.ac.za:/data/40in/sh?/<YYYY>/<MMDD>/*.fits /LocalFilePath
There are two ways to transfer data: (1) directly to your computer or (2) onto the SAAO storage area network (SAN). The data are automatically copied to the server every morning (at 9:30am).* (1) To transfer data directly to your computer, use the command line.** Open a shell on your local PC (Putty if you're using Windows or a bash/tcsh/sh if on Mac or Linux)** Copy the data using the following command, depending on the telescope: rsync -avzP shoc74in@shoc74in.suth.saao.ac.za:/data/74in/sh?/<YYYY>/<MMDD>/*.fits /LocalFilePath rsync -avzP shoc40in@shoc40in.suth.saao.ac.za:/data/40in/sh?/<YYYY>/<MMDD>/*.fits /LocalFilePath ---- where sh? is a wildcard that will point to the correct instrument mounted on the telescope for that night and "/LocalFilePath" is the location on your local machine ---- the password is that for the shoc74in or shoc40in accounts** NOTE: if the rsync command fails, try it WITHOUT the wildcard (*). Some rsync programs apparently do not support this function.
NOTE: Data are moved * (2) To move data to the SAN on the Sutherland plateau every morning at 9:30am. However, if (from which you're wanting to get your data can access it by connecting to the SAN (and from SAAO server), there is a data copy script on the SHOC computer. ** From a command line, connect to the servers in Cape Town sooner than 9instrument computer. As appropriate for your telescope, use either of the following commands:30am) you MUST have run ssh shoc74in@shoc74in.suth.saao.ac.za ssh shoc40in@shoc74in.suth.saao.ac.za ---- When prompted for the password, use the password for the 74in or 40in user.**Run the shocdatacopy.sh script in order . Options can be: shocdatacopy.sh -d yesterday # to get the transfer yesterday's data shocdatacopy.sh -d YYYYMMDD # to transfer data from some specified date ---- Without parameters, it will try to transfer today's data.** To collect your data from the SAN, you'll have to secure copy it from '''astro. You can then obtain suth.saao.ac.za'''. The usernames for this are '''ccd40''' and '''ccd74''' depending on your telescope. Ask for the password. Data are in the path /data from /telescopedata/<TELESCOPE>/sh?/<YYYY>/<MMDD> rsync -avzP ccd74@astro.suth.saao.ac.za (or :/data/telescopedata/74in/sh?/<YYYY>/<MMDD>/*.fits /LocalFilePath rsync -avzP ccd40@astro.capesuth.saao.ac.za if you're back in Cape Town):/data/telescopedata/40in/sh?/<YYYY>/<MMDD>/*. See Data Transfer information under fits /LocalFilePath ---- where SH? is a wildcard that will point to the advanced guide below for details correct instrument mounted on how to transfer to the SAN.telescope for that night; YYYY is the year; MMDD is the month and day; and "/LocalFilePath" is the location on your local machine
Running * Useful: **On the shocdatacopy.sh script as follows SHOC computers, the 'tree' command will transfer data assist you in trying to astrolook at what folders and files are under that directory.suth.saao.ac.za in Sutherland. This can ** For information on the script, a logfile is produced that will be in /var/log/<TELESCOPE>DataCopyLog<MMDD>-<NUM> where <TELESCOPE> is 40in or 74in <MMDD> MonthDay <NUM> the Nth time this script has been run as  NOTE: Data are moved to the user SAN on the plateau every morning at 9:30am. However, if you're wanting to get your data to the SAN (shoc40in or shoc74inand from there to the servers in Cape Town sooner than 9:30am) on you MUST have run the various SHOC machinesshocdatacopy. To do sh script in order to get the transfer, log into shoc74indata to the SAN. You can then obtain the data from astro.suth.saao.ac.za (or shoc40inastro.suthcape.saao.ac.zaif you're back in Cape Town) as the appropriate user, then run the script: shoc74in@shocnawe:~$ shocdatacopy.sh [-d today|yesterday]
===Advanced users guide ===
187
edits