Project

General

Profile

Pion LT Software Meetings » History » Version 27

Nathan Heinrich, 04/16/2021 05:07 PM

1 1 Stephen Kay
{{>TOC}}
2
3
h1. Pion LT Software Meetings
4
5
Pion LT software meetings. Please add your talk to the meeting ahead of time. Add the newest meeting to the top of the list!
6 17 Stephen Kay
7
----
8
9 24 Nathan Heinrich
h2. 2021.04.19 PionLT Software Meeting
10
11
* Nathan Presented his Selections for Heep data
12 26 Nathan Heinrich
[[https://redmine.jlab.org/attachments/download/1226/PionLT_Elasitics_Selection_Nathan.ods]]
13 27 Nathan Heinrich
[[https://redmine.jlab.org/attachments/download/1227/Nathan_PionLT_Heep_selection_2021.pdf]]
14 24 Nathan Heinrich
15
----
16
17 23 Stephen Kay
h2. 2021.04.12 PionLT Software Meeting
18
19
* Discussed HeeP studies further, including event requirements
20
** Clarified that 10k events is the lower limit for singles
21
** 50k events for coin runs
22
* Need to tweak all DEF-cuts files, want *All Events*, can cut out EDTM manually after as needed
23
** Carlos wants to use EDTM events so can't remove them
24
** Ali will need to tweak some cuts accordingly to include a removal of the EDTM events
25
* Stephen highlighted that HeeP physics analysis scripts are in major need of a refresh
26
** Still using old TProof based method, should switch to Python
27
** Need more robust file checking/finding in script too
28
* Garth highlighted that Peter Bosted had made it very clear that the Physics settings where the current was varied were *incredibly* useful
29
** Want to try working some runs like this into the upcoming run plan
30
** Allow us to check FADC efficiencies as fn of rate/current
31
32
----
33
34
h2. 2021.04.05 PionLT Software Meeting
35
36
* I (Stephen) wasn't there so some minutes would be nice!
37
38
----
39
40
h2. 2021.03.29 PionLT Software Meeting
41
42
* Jacob updated on HeeP studies
43
** Fixed rate issues seen previously
44
** Still seeing odd results, can't reconstruct earlier rates
45
*** Factor ~10 out, probably some odd units?
46
* Carlos clarified issues Stephen was having with new Helicity stuff in the replay
47
* Vijay suggested switching to Etottracknorm in some Physics analysis (and including it in the DEF-files)
48
** Should definitely be kept, doesn't make a huge difference for low level analysis though
49
*** Working this into scripts will take a little bit of work, can update it as we go along
50
** Also including Aero X/Y  in all DEF-files now too
51
52
----
53
54 21 Stephen Kay
h2. 2021.03.22 PionLT Software Meeting
55
56
* Casey reported that he had managed to get hcana to compile with root 6.18.00
57
** Stephen mentioned he'd had some conflicts with 6.18.04 - will test 6.18.00 too
58
* Jacob seeing some replayed files with streamer info missing errors
59
** Stephen mentions this is likely just an incomplete or failed replay, if it keeps happening though more info will be needed
60
* Casey reported on some more updates to his timing window scripts
61
** Now work with HMS windows too
62
** Mentioned that Bill Henry is looking at some potentially useful pulse amp plots, useful for other detectors
63
** Pulse int vs timing windows for different detectors and other plots
64
* Stephen gave an overview of upcoming software tasks
65
** Big item on the near horizon is the upcoming second replay of the kaon data, not independent of the pion software work!
66
*** Need updated report files, new efficiencies in the file, new information in the file
67
*** DEF-Files still need updating and cleaning, what can we trim out?
68
*** Which trees do we actually need in each type of replay
69
*** Which types of events should we actually specify -> ALL_Events vs ALL_Events_No_EDTM issue Richard saw recently
70
*** Helicity scalers included now too
71
*** Want to cross check electronic live time multiple ways
72
** A point was raised that we should aim to verify selection cutting in the DEF files yields the same result as post processing the replays with the "same" cuts
73 22 Stephen Kay
** Carlos pointed out that we need to be sure to compare the *exact* same value in our report files and in our data
74 21 Stephen Kay
** Casey requested calibration replay and shell scripts
75
*** Stephen forwarded these on
76
** SHMS Calibration code was not in latest hallc_replay repository
77
*** Casey mentioned Bill Henry hasn't merged it yet, some work is apparently still on going
78
*** Casey is going to follow up on this with Bill as he had some other items to discuss with him too
79
** SIMC comparisons were raised
80
*** Not quite there yet in our analysis, will be coming very soon (within next month or two) though
81
*** Garth mentioned he has a slightly different SIMC branch with different generators available
82
** Need to make sure updates to kaon analysis feed into the pion analysis and vice versa
83
* Garth showed and discussed the latest beam schedule
84
** Long beamtime for PionLT this year
85
** Final part of experiment actually expected to run next year (2022)
86
** Going to be a busy year or two!
87
88
----
89
90 19 Stephen Kay
h2. 2021.03.15 PionLT Software Meeting
91
92
* Replay and Python script running discussion
93
** Git changes, new branch for hallc_replay_lt/UTIL_PION/UTIL_BATCH - _offline_pionlt_
94
*** Need to modify repo setup script, some issues if branch doesn't exist
95
*** Will add instructions on how to get and update new branch
96
*** Will also modify so it automatically checks if the branch exists and gets it if not
97
** Pathing changes for c-pionlt and directory structure now all done, working well
98
** Some issues with replay scripts, both related to hcana updates
99
*** How the pcal_geom file is read in has been changed, variable needs to be VAL, VAL and not VAL VAL (comma instead of space) now
100
*** Helicity stuff no longer working, needed to be commented out for scripts to run
101
*** Carlos mentioned there's a new map for this, will need to update from hallc_replay
102
** Garth raised that Brad was potentially working on an improved GUI for checking online EDTM rates
103
*** Double check/follow up on this?
104
** Discussion of analysis scripts in more detail
105
*** How the MM is calculated, discussed adjusted values
106
*** How CT is calculated for each particle species
107
*** How RF time is utilised in PID
108 20 Stephen Kay
*** Vijay showed RF vs delta and RF vs MM plots and how these can be utilised in PID - "RFvDelta":https://redmine.jlab.org/attachments/download/1200/Kaon_RFtime_delta.pdf, "RFvMM":https://redmine.jlab.org/attachments/download/1201/Kaon_mm_FRtime.pdf, both with Kaon PID cuts applied
109 19 Stephen Kay
*** Stephen will send on some documentation on these topics to Jacob/Julie
110
** To do list for software
111
*** Update hallc_replat_lt with hallc_reply maps
112
*** Install new hcana in c_kaonlt area
113
*** Push all hallc_replay_lt fixes
114
*** Update git script, add instructions
115
116
----
117
118 18 Stephen Kay
h2. 2021.03.08 PionLT Software Meeting
119
120
* HeeP studies discussion
121
** Discussed minimal criteria for singles runs
122
*** No setting shorter than 12 minutes
123
*** No setting longer than one hour
124
*** No setting with less than 10k events
125
*** Want elastics rates of under 100 kHz
126
** Criteria/Discussion for coin runs
127
*** Want roughly 50k elastics
128
*** Multiple would be good
129
*** ~3 hours for one previous setting (at 50% data taking eff), this is OK
130
** Discussed solid angles for each spectrometer
131
*** HMS - 8 mSr, 8.1? 
132
*** SHMS - 3.5 mSr, Carlos states > 4 mSr in his thesis
133
** Both Nathan and Jacob had some spreadsheets with settings analysed, a few numbers did not match previous settings, both looking into this (probably a solid angle off or similar)
134
** Garth sent on Fortran code for cross sections
135
* Analysis Code Updates
136
** Stephen has finalised the pathing/directory structure updates for
137
*** hallc_replay_lt
138
*** UTIL_PION
139
*** UTIL_BATCH
140
** All have a new branch, *offline_pionlt*
141
** Further testing and updates needed, Stephen will work through updating the scripts for the calibrations now that the new structure is set up
142
*** Some are outdated now, DC, Hodoscopes e.t.c (grab wrong DB files to begin with)
143
* Numerous people reported that the farm was very slow over the weekend, if this continues, should raise with Brad/SciComp
144
145
----
146
147 17 Stephen Kay
h2. 2021.03.01 PionLT Software Meeting
148
149
* HeeP studies
150
** Students still working on this, Jacob looking at rate calculations
151
* Stephen - updates on new git and directory setup scripts
152
** Scripts in place but still some work on hallc_replay_lt and UTIL_BATCH needed
153
*** Issues with pathing that need to be corrected for new area
154
*** Should have these finalised by mid/late this week
155
** Jacob has tested and seems to be working OK
156
** Will work on updating/testing DC/Calorimeter calibration scripts next
157
* Jacob conducting sanity checks on new matrix elements, noticed discrepancy between kaonlt/pionlt hcana and previous versions, likely due to changes in hcana from April last year
158
** Mark gave some talk on this last year - "Talk1":https://hallcweb.jlab.org/DocDB/0010/001060/002/update_april2020.pdf , "Talk2":https://hallcweb.jlab.org/DocDB/0010/001055/001/HCANA_Hodo_changes_april2020.pdf, "Talk3":https://hallcweb.jlab.org/DocDB/0010/001056/001/April%202020%20HCANA%20changes%20for%20other%20detectors.pdf
159
* Meeting time discussed, remaining at 13:00 ET (which means it shifts to 11:00 Regina time)
160
 
161 16 Stephen Kay
----
162 1 Stephen Kay
163 16 Stephen Kay
h2. 2021.02.22 PionLT Software Meeting
164
165
* Updates from the group
166
** Garth
167
*** HeeP data discussion, one per beam energy
168
**** KaonLT and PionLT Phase I had nearly every beam energy setting
169
*** Updates about the new target config, phase II and III of PionLT likely going to have new target ladder
170
*** Thicker aluminium cans, CAD design done but not completely finalised, will know soon
171
*** KaonLT beamline will be used in 2021 run, new beamline for 2022 run
172
*** Start of run pushed back slightly, 2022 run will be May to December, PionLT might be slotted into parts of this
173
** Stephen
174
*** Demo2 script fixed, bug was slightly stupid, run not in range but the script did not report this
175
**** Will look at tweaks to kaonlt.py to fix this
176
*** New hcana installed in pionlt area, used root 6.14.04, scons issue with newer root (6.18.04)
177
*** Will create setup scripts for use in migrating over to this area for working
178
*** Minor issue with /cache/c-pionlt directory, permissions related
179
180
* Discussed plans and potential problems for upcoming run regarding COVID procedures, how many people can be on shift, how many people will travel and so on
181
* Will need to shift meeting time in a few weeks due to daylight savings time change for some people
182
183 1 Stephen Kay
----
184
185 14 Stephen Kay
h2. 2021.02.15 PionLT Software Meeting
186
187
* Updates from the group
188 15 Stephen Kay
** Carlos
189
*** Previously looked at optimisation of kinematics for HeeP data
190
*** Document on "DocDB":https://hallcweb.jlab.org/DocDB/0010/001036/002/HC_SoftwareMeeting_Oct03_2019_pdf.pdf
191
*** Will revisit this and try to make some notes on code
192
** Stephen
193
*** No major updates, resolved some issues with scripts Jacob/Junaid were having
194
*** /group/c-pionlt now exists, will try to install hcana here with a more up to date version of root
195
*** Garth mentioned some changes to farm software, cmake, singularity, Jupyter - shouldn't affect us much
196
** Nathan
197
*** Combing hodo script DBase files, will try and update, including batch scripts
198
** Jacob 
199
*** Sanity checks of running old scripts and comparing to new
200
*** Should be in place to combine in new matrix elements soon
201
** Junaid
202
*** demo1 being slow, file probably too large
203
*** Farm also being slow could be an issue
204
** Ali
205
*** Sym link hardcoding, switch location of outputting
206
207
* Idea of a directory setup script, something people can run and it will set up a tree of directories to save files to
208
** Can try making a version of this later this week, will need to modify output of lots of scripts!
209 14 Stephen Kay
210
----
211
212 10 Stephen Kay
h2. 2021.02.08 PionLT Software Meeting
213
214
* Updates from the group
215
** Stephen - Tried to replicate errors Jacob was having with Demo2, could not replicate issues and didn't see any script differences
216
*** May be a versioning issue, Stephen and Richard will investigate further
217
*** JLab environment/root version issue likely cause
218
** Jacob - Questions about the pionlt directories, all but the /group/c-pionlt one seem to be set up
219
*** Stephen following up with Brad on this
220
** Junaid - Some environment issues
221
*** Stephen will try to resolve later today
222
** Casey - Gave an update on his timing window scripts
223
*** https://github.com/mrcmor100/hallc_replay_XEM/tree/timing
224
*** Scripts look very nice, compare timing windows to existing ones and upload plots to network accessible location
225
*** Stephen will take a look at how they can be adapted for our coincidence running
226 13 Stephen Kay
* HeeP running discussion
227 12 Stephen Kay
** Minimum accessible spectrometer angles - SHMS 5.5, HMS 10.5, opening angle ??
228
** Want higher for HeeP running for practicality (no hall access e.t.c.)
229 10 Stephen Kay
230
----
231
232 3 Garth Huber
h2. 2021.02.01 PionLT Software Meeting
233 2 Stephen Kay
 
234
* Updates from the group
235
** Stephen - Cointime peak script updates and fixes
236
** Jacob - Issues with Demo2 cuts
237
*** Stephen thinks this may be due to lack of updating of the script after some changes Richard made, will investigate
238
** Nathan - Hodoscope script issues, tracked down to .database file. Investigating fixes
239
** Junaid - Software setup on Lark but python/root issues here, working on JLab account. Will investigate root compilation on Lark
240
*** Stephen raised that issue in getting root to compile isn't actually related to the python version used, other package/component causing issues
241
** Ali - Working on improving report files and def files
242
* "Casey Presentation":https://redmine.jlab.org/attachments/download/1175/pionLTgroup_presentation.pptx
243
** Discussion of process and software used by XEM experiment
244
** Nice reference time script in place, will exchange with Stephen/Richard and see what can be merged with each
245
** Structure and plan for analysis look similar to our own, will try to collaborate as much as possible on having a nice working set of software for online usage
246
** Raised point of online BCM/BPM monitoring
247
*** Dave mentioned it would be nice to track the stability of the BCM/BPMs over the run period, at least once per shift produce a plot/document checking this
248
*** Stephen added that this could also track the prescale factors (reported vs calculated)
249
*** Investigate idea of a once per shift script that checks last X runs and produces plots above
250
251
----
252 1 Stephen Kay
253 3 Garth Huber
h2. 2021.01.25 PionLT Preparation Meeting
254
255
* Garth Discussed run plan kinematics, purpose of Heep runs, and Luminosity scans
256
** Homework: students should look at distributed Heep kinematics and try to find some sets of singles (e') and coin (e'+p) runs which would overlap either in energy or angle with the physics kinematics, for the purpose of establishing angle and momentum offsets.
257
** Jacob also looked through Garth's physics kinematics spreadsheet, and did not find any additional errors, beyond the one GH had already identified.  That error turned out to be an error in the kinematics table in the Jeopardy (2019) proposal, and GH subsequently distributed a corrected spreadsheet.
258 4 Garth Huber
[[https://redmine.jlab.org/attachments/download/1176/pion_runplan_21jan26.ods]]
259 5 Garth Huber
[[https://redmine.jlab.org/attachments/download/1178/elas_9p900gev.out]]
260 6 Garth Huber
[[https://redmine.jlab.org/attachments/download/1179/elas_9p200gev.out]]
261 7 Garth Huber
[[https://redmine.jlab.org/attachments/download/1180/elas_8p000gev.out]]
262 8 Garth Huber
[[https://redmine.jlab.org/attachments/download/1182/elas_6p000gev.out]]
263 6 Garth Huber
264 9 Garth Huber
----
265
266 3 Garth Huber
h2. 2021.01.12 PionLT Software Meeting
267 1 Stephen Kay
 
268
* "Stephen Presentation":https://redmine.jlab.org/documents/122
269
** Discussion of analysis tasks and status as of 12/01/21. The non-annotated version of the notes is also available "here":https://redmine.jlab.org/documents/123
270
** Homework for next week is the following -
271
*** Setup and try the batch calibration scripts and the python analysis script demo
272 6 Garth Huber
*** For Stephen - Check with Brad regarding new area for files