Writing to EOS¶
The Purdue EOS storage is mounted read-only at /eos/purdue/. To write files
to EOS (for example, to your Grid directory /store/user/<cern-username>/), use
the gfal or xrdcp/xrdfs commands.
A typical workflow is: save job outputs into /tmp/<username>/ (on the session,
Slurm job, or Dask worker that produced them), then copy them to EOS — see
Storage volumes for why this is preferred over writing to Depot from
many jobs at once.
Using xrdcp and xrdfs¶
This is the more straightforward option and only requires a valid VOMS proxy:
Then, for example:
# copy a local file to your Grid directory on Purdue EOS
xrdcp /tmp/$USER/output.root root://eos.cms.rcac.purdue.edu//store/user/<cern-username>/output.root
# list the contents of a directory
xrdfs root://eos.cms.rcac.purdue.edu ls /store/user/<cern-username>/
Documentation on xrdcp is available at the
Purdue Tier-2 CMS site.
Using gfal¶
The gfal commands are documented at the
Purdue Tier-2 CMS site.
In order to use gfal at the facility, first run these commands in your terminal:
voms-proxy-init -verify --rfc --voms cms -valid 192:00
source /cvmfs/oasis.opensciencegrid.org/osg-software/osg-wn-client/current/el8-x86_64/setup.sh
After these commands, gfal should work, e.g.:
gfal-copy /tmp/$USER/output.root root://eos.cms.rcac.purdue.edu//store/user/<cern-username>/output.root
See also
- Data access — copying files from other CMS sites
- Storage volumes — where CRAB and Rucio outputs end up