JLab Farm Information » History » Version 10
Stephen Kay, 01/25/2021 01:37 PM
| 1 | 1 | Stephen Kay | h1. JLab Farm Information |
|---|---|---|---|
| 2 | |||
| 3 | Included below is some information and resources regarding working with the PionLT data on the JLab farm. |
||
| 4 | |||
| 5 | h2. General Farm Resources |
||
| 6 | |||
| 7 | 10 | Stephen Kay | * "Farm Tips and Tricks":https://redmine.jlab.org/attachments/download/1174/Computing_tools-tricks-Jun2018.pdf |
| 8 | 1 | Stephen Kay | * "JLab SciComp Info Pages":https://scicomp.jlab.org/docs/ |
| 9 | 2 | Stephen Kay | ** "Tape Storage System Info":https://scicomp.jlab.org/docs/storage |
| 10 | ** "Auger batch queueing system":https://scicomp.jlab.org/docs/batch |
||
| 11 | 1 | Stephen Kay | *** Note, auger will be replaced by Slurm eventually, we're still using auger for now |
| 12 | 3 | Stephen Kay | * "Check Job/Farm Status":https://scicomp.jlab.org/scicomp/index.html#/ |
| 13 | 1 | Stephen Kay | |
| 14 | 8 | Stephen Kay | h2. Git Instructions/Info |
| 15 | |||
| 16 | * "Git Instructions":https://redmine.jlab.org/attachments/download/1173/Git_Instructions.pdf |
||
| 17 | |||
| 18 | 1 | Stephen Kay | h2. Summer 2019 Run Info |
| 19 | 2 | Stephen Kay | |
| 20 | The Summer 2019 data was stored alongside the earlier KaonLT data. The data can be found in - |
||
| 21 | |||
| 22 | * /mss/hallc/spring17/raw/ - Raw data for 2019 PionLT run |
||
| 23 | * /mss/hallc/kaonlt/ - Analysed data |
||
| 24 | * /volatile/hallc/c-kaonlt/ - Temporary analysed data |
||
| 25 | |||
| 26 | Access to these directories is via the "c-comm2017" group |
||
| 27 | 1 | Stephen Kay | |
| 28 | h2. 2021 Run Info |
||
| 29 | |||
| 30 | For the 2021 PionLT run, a new group was created, along with numerous new directories - |
||
| 31 | |||
| 32 | * New unix group: 'c-pionlt' |
||
| 33 | * New Farm/Auger project: c-pionlt |
||
| 34 | 7 | Stephen Kay | ** Use this Project name for simulation (and later analysis) jobs on the Farm |
| 35 | 1 | Stephen Kay | * Disk resources: |
| 36 | ** /volatile/c-pionlt/ - directory, 6 TB high quota; 2 TB Guarantee |
||
| 37 | ** /group/c-pionlt/ - directory (100GB quota) |
||
| 38 | *** snapshotted hourly; backed up automatically, use for analysis scripts, etc. |
||
| 39 | ** /work/hallc/c-pionlt/ - directory (1TB quota) |
||
| 40 | *** NOT backed up in any way |
||
| 41 | 5 | Stephen Kay | *** Has some small-file/performance benefits (but this doesn't really apply to hcana/podd analysis) |
| 42 | 6 | Stephen Kay | *** Not super useful in a modern workflow (mostly historical), but it's there if you want it. |
| 43 | 1 | Stephen Kay | *** Not intended for rootfile output or to store extra copies of CODA files, etc. |
| 44 | *** Good for large source code bases (that are 'backed up' on an external git repo, for example) |
||
| 45 | *** OK for modestly sized simulation output perhaps, though /volatile is still best. |
||
| 46 | ** New Tape/disk allocations: |
||
| 47 | *** /mss/hallc/c-pionlt/raw - tape volume for raw data output |
||
| 48 | *** /mss/hallc/c-pionlt/analysis - tape volume for analysis output |
||
| 49 | 9 | Stephen Kay | ** CACHE INFO COMING SOON |