JLab Farm Information » History » Revision 3
Revision 2 (Stephen Kay, 01/19/2021 01:12 PM) → Revision 3/10 (Stephen Kay, 01/19/2021 01:13 PM)
h1. JLab Farm Information Included below is some information and resources regarding working with the PionLT data on the JLab farm. h2. General Farm Resources * "JLab SciComp Info Pages":https://scicomp.jlab.org/docs/ * "Check Job/Farm Status":https://scicomp.jlab.org/scicomp/index.html#/ ** "Tape Storage System Info":https://scicomp.jlab.org/docs/storage ** "Auger batch queueing system":https://scicomp.jlab.org/docs/batch *** Note, auger will be replaced by Slurm eventually, we're still using auger for now * "Check Job/Farm Status":https://scicomp.jlab.org/scicomp/index.html#/ h2. Summer 2019 Run Info The Summer 2019 data was stored alongside the earlier KaonLT data. The data can be found in - * /mss/hallc/spring17/raw/ - Raw data for 2019 PionLT run * /mss/hallc/kaonlt/ - Analysed data * /volatile/hallc/c-kaonlt/ - Temporary analysed data Access to these directories is via the "c-comm2017" group h2. 2021 Run Info For the 2021 PionLT run, a new group was created, along with numerous new directories - * New unix group: 'c-pionlt' * New Farm/Auger project: c-pionlt ** Use this Project name for simulation (and later analysis) jobs on the Farm * Disk resources: ** /volatile/c-pionlt/ - directory, 6 TB high quota; 2 TB Guarantee ** /group/c-pionlt/ - directory (100GB quota) *** snapshotted hourly; backed up automatically, use for analysis scripts, etc. ** /work/hallc/c-pionlt/ - directory (1TB quota) *** NOT backed up in any way *** Has some small-file / performance benefits (but this doesn't really apply to hcana/podd analysis) *** Not super useful in a modern workflow (mostly historical), butnit's there if you want it. *** Not intended for rootfile output or to store extra copies of CODA files, etc. *** Good for large source code bases (that are 'backed up' on an external git repo, for example) *** OK for modestly sized simulation output perhaps, though /volatile is still best. ** New Tape/disk allocations: *** /mss/hallc/c-pionlt/raw - tape volume for raw data output *** /mss/hallc/c-pionlt/analysis - tape volume for analysis output