Facilities > VLA > Data Archive > DSOC EVLA Archive Issues

DSOC EVLA Archive Issues

by Gustaaf Van Moorsel last modified Oct 02, 2013

DSOC EVLA Archive Issues

DSOC EVLA Archive Issues

 

Data Format

Those residing at the DSOC are requested to retrieve their EVLA data in SDM format only, in order to decrease the pressure on the archiving machines. Note that this is no longer the default setting on the archive retrieval page. There is no reason to request the tar-file as it only adds processing time and disk space requirements.

Data Destination

On the archive retrieval page, the default destination for archive files is set for internet downloads. To avoid having to copy over your data to another directory (on your local machine, or lustre) you have the (preferred) option to write directly to one of your own directories. For that to work that directory has to have world write access (chmod a+rwx <dir>), and you specify its full path in the destination input field.

Note that your own directory is not secured until you change the permissions on it again (chmod go+rwx <dir>), so if you are very suspicious of your colleagues you can still use the default and copy the data over when an email tells you it is ready. If so, you will be informed: "You may use this link to go directly to the temporary directory : TEMPDIR", where TEMPDIR is of the form: two characters followed by four numbers. The requested file can be accessed at: /home/e2earchive/stage/TEMPDIR. 'Accessing' can mean copying the full directory to a local disk using cp -r or specifying the input as a remote file in CASA.

Data conversion

The vast majority of local staff will want to reduce the data in either CASA or AIPS:

  • CASA. Use CASA software to convert the SDM into a measurement set. Available tasks are importasdm or importevla (the latter is a special version of importasdm allowing various kinds of flagging).
  • AIPS. Use the procedure bdf2aips in AIPS to load in the SDM