Project

General

Profile

JLab Farm Information » History » Version 9

Stephen Kay, 01/25/2021 01:25 PM

1 1 Stephen Kay
h1. JLab Farm Information
2
3
Included below is some information and resources regarding working with the PionLT data on the JLab farm.
4
5
h2. General Farm Resources
6
7
* "JLab SciComp Info Pages":https://scicomp.jlab.org/docs/
8 2 Stephen Kay
** "Tape Storage System Info":https://scicomp.jlab.org/docs/storage
9
** "Auger batch queueing system":https://scicomp.jlab.org/docs/batch
10 1 Stephen Kay
*** Note, auger will be replaced by Slurm eventually, we're still using auger for now
11 3 Stephen Kay
* "Check Job/Farm Status":https://scicomp.jlab.org/scicomp/index.html#/
12 1 Stephen Kay
13 8 Stephen Kay
h2. Git Instructions/Info
14
15
* "Git Instructions":https://redmine.jlab.org/attachments/download/1173/Git_Instructions.pdf
16
17 1 Stephen Kay
h2. Summer 2019 Run Info
18 2 Stephen Kay
19
The Summer 2019 data was stored alongside the earlier KaonLT data. The  data can be found in -
20
21
* /mss/hallc/spring17/raw/ - Raw data for 2019 PionLT run
22
* /mss/hallc/kaonlt/ - Analysed data
23
* /volatile/hallc/c-kaonlt/ - Temporary analysed data
24
25
Access to these directories is via the "c-comm2017" group
26 1 Stephen Kay
27
h2. 2021 Run Info
28
29
For the 2021 PionLT run, a new group was created, along with numerous new directories -
30
31
* New unix group: 'c-pionlt'
32
* New Farm/Auger project: c-pionlt
33 7 Stephen Kay
** Use this Project name for simulation (and later analysis) jobs on the Farm
34 1 Stephen Kay
* Disk resources:
35
** /volatile/c-pionlt/ - directory, 6 TB high quota;  2 TB Guarantee
36
** /group/c-pionlt/ - directory (100GB quota)
37
*** snapshotted hourly; backed up automatically, use for analysis scripts, etc.
38
** /work/hallc/c-pionlt/ - directory (1TB quota)
39
*** NOT backed up in any way
40 5 Stephen Kay
*** Has some small-file/performance benefits (but this doesn't really apply to hcana/podd analysis)
41 6 Stephen Kay
*** Not super useful in a modern workflow (mostly historical), but it's there if you want it.
42 1 Stephen Kay
*** Not intended for rootfile output or to store extra copies of CODA files, etc.
43
*** Good for large source code bases (that are 'backed up' on an external git repo, for example)
44
*** OK for modestly sized simulation output perhaps, though /volatile is still best.
45
** New Tape/disk allocations:
46
*** /mss/hallc/c-pionlt/raw - tape volume for raw data output
47
*** /mss/hallc/c-pionlt/analysis - tape volume for analysis output
48 9 Stephen Kay
** CACHE INFO COMING SOON