Project

General

Profile

JLab Farm Information » History » Version 6

Stephen Kay, 01/19/2021 03:51 PM

1 1 Stephen Kay
h1. JLab Farm Information
2
3
Included below is some information and resources regarding working with the PionLT data on the JLab farm.
4
5
h2. General Farm Resources
6
7
* "JLab SciComp Info Pages":https://scicomp.jlab.org/docs/
8 2 Stephen Kay
** "Tape Storage System Info":https://scicomp.jlab.org/docs/storage
9
** "Auger batch queueing system":https://scicomp.jlab.org/docs/batch
10 1 Stephen Kay
*** Note, auger will be replaced by Slurm eventually, we're still using auger for now
11 3 Stephen Kay
* "Check Job/Farm Status":https://scicomp.jlab.org/scicomp/index.html#/
12 1 Stephen Kay
13
h2. Summer 2019 Run Info
14 2 Stephen Kay
15
The Summer 2019 data was stored alongside the earlier KaonLT data. The  data can be found in -
16
17
* /mss/hallc/spring17/raw/ - Raw data for 2019 PionLT run
18
* /mss/hallc/kaonlt/ - Analysed data
19
* /volatile/hallc/c-kaonlt/ - Temporary analysed data
20
21
Access to these directories is via the "c-comm2017" group
22 1 Stephen Kay
23
h2. 2021 Run Info
24
25
For the 2021 PionLT run, a new group was created, along with numerous new directories -
26
27
* New unix group: 'c-pionlt'
28
* New Farm/Auger project: c-pionlt
29
   ** Use this Project name for simulation (and later analysis) jobs on the Farm
30
* Disk resources:
31
** /volatile/c-pionlt/ - directory, 6 TB high quota;  2 TB Guarantee
32
** /group/c-pionlt/ - directory (100GB quota)
33
*** snapshotted hourly; backed up automatically, use for analysis scripts, etc.
34
** /work/hallc/c-pionlt/ - directory (1TB quota)
35
*** NOT backed up in any way
36 5 Stephen Kay
*** Has some small-file/performance benefits (but this doesn't really apply to hcana/podd analysis)
37 6 Stephen Kay
*** Not super useful in a modern workflow (mostly historical), but it's there if you want it.
38 1 Stephen Kay
*** Not intended for rootfile output or to store extra copies of CODA files, etc.
39
*** Good for large source code bases (that are 'backed up' on an external git repo, for example)
40
*** OK for modestly sized simulation output perhaps, though /volatile is still best.
41
** New Tape/disk allocations:
42
*** /mss/hallc/c-pionlt/raw - tape volume for raw data output
43
*** /mss/hallc/c-pionlt/analysis - tape volume for analysis output