Project

General

Profile

Pion LT Software Meetings » History » Version 33

Stephen Kay, 06/30/2021 06:42 PM

1 1 Stephen Kay
{{>TOC}}
2
3
h1. Pion LT Software Meetings
4
5
Pion LT software meetings. Please add your talk to the meeting ahead of time. Add the newest meeting to the top of the list!
6 30 Stephen Kay
7 33 Stephen Kay
8
----
9
10
h2. 2021.06.30 PionLT Software Meeting
11
12
* SIMC Rate Work
13
** Nathan - progressing well, hopefully done by next week
14
** Jacob
15
*** Accidentally duplicated (in terms of output/purpose) Nathan's script - good for cross checking anyway
16
*** Some minor fixes needed
17
*** Lots of rates ending up 0 - Detector arms not labelled correctly in some input files
18
*** Reminder to check target thickness in the input file carefully - should be 10cm!
19
* Online Software update
20
** "Stephen's slides":https://redmine.jlab.org/attachments/download/1237/Pion_Planning_30_06_21.pdf
21
** "Task allocations":https://redmine.jlab.org/attachments/download/1238/Allocations.png
22
23 30 Stephen Kay
----
24
25
h2. 2021.05.10 PionLT Software Meeting
26
27
* HeeP Updates
28
** Nathan
29
*** Errors in calculation, Jacob spotted, factor 50 out. Corrected now, some settings no longer viable, some now potentially more doable
30
*** Acceptance difference in code between Nathan/Jacob noted, 3.5 vs 4 for the HMS
31
*** Updated settings sent to Garth
32
** Jacob 
33
*** Settings sent to Garth, some overlap with Junaid
34
** Junaid 
35
*** Settings sent to Garth
36
** Should hopefully have a set of preliminary settings next week from combination of all three sent on to Garth
37
* Software Updates
38
** Stephen
39
*** Calorimeter calibration code updates from Bill Henry being worked in, HMS working, SHMS has some issues
40
*** Will update github structure for KaonLT once calorimeter calib updates finalised
41
** Nathan
42
*** Hodoscope calibration script updates, SHMS looking OK **except** for 2y+ plane
43
*** Something odd going on, will investigate further, does tree actually have any entries?
44
*** Observed that chi2 fit value on plot isn't actually very useful currently, maybe remove
45
*** HMS calibration proving problematic, some plots nearly empty, why?
46
*** Will look into this, try and figure out what is going wrong, could just be a plot range issue?
47 32 Stephen Kay
*** "Hodoscope Calibrations Update Slides":https://redmine.jlab.org/attachments/download/1228/HodoCalibUpdate20210510.pdf
48 30 Stephen Kay
** Upcoming software tasks discussed
49
*** Analysis software **mostly** in good shape
50
*** Heep analysis scripts need updating/checking -> Jacob volunteered to take a look
51
*** Timing window scripts not finalised, lots of different bits of code which need combining -> Nathan volunteered to take a look
52
*** Need to do next replay with EDTM events included for Carlos
53
*** Helicity scalers only important for Pion runs
54
* Noticed only one more meeting actually scheduled - Need to discuss future meeting time next week?
55
56
----
57
58
h2. 2021.05.03 PionLT Software Meeting
59
60
* Junaid, Heep discussion
61
** Has multiple settings at 12.35 degrees across all beam energies
62
** Question on offsets -> Get offsets mainly from Coin settings
63
*** Get cross section info from singles
64
* Nathan, Hodoscope updates
65
** Run OK interactively
66
*** Some issues running on farm
67
** Fixed some issues seen with calibration previously, plot ranges e.t.c.
68
** Nearly ready for pass 2
69
* Ali, report file update
70
** All new, made from scratch
71
** Working on incorporating new info into DEF-CUTS files
72
73 29 Stephen Kay
----
74 17 Stephen Kay
75 29 Stephen Kay
h2. 2021.04.26 PionLT Software Meeting
76
77
* Nathan, Heep discussion
78
** SHMS can match HMS settings OK
79
** No less than 2 degrees between different singles settings ideally, had some settings closer than this, check delta, is it within pm 8%?
80
*** Can probably overlap many existing (close in angle) settings with 1 new setting
81
*** Acceptance covers many settings with adequate stats
82
** Need to incorporate some runs with the same angle, but at multiple beam energies
83
* Jacob, processing various settings too
84
* To come from Junaid/Jacob/Nathan - One sheet of proposed settings for each beam energy, Garth will compile
85
* Jacob confirmed new matrix elements for HMS are **only** for 7.59 GeV/c
86
87 17 Stephen Kay
----
88
89 24 Nathan Heinrich
h2. 2021.04.19 PionLT Software Meeting
90
91
* Nathan Presented his Selections for Heep data
92 32 Stephen Kay
** "Heep Settings Spreadheet":https://redmine.jlab.org/attachments/download/1226/PionLT_Elasitics_Selection_Nathan.ods
93
** "Heep Settings pdf":https://redmine.jlab.org/attachments/download/1227/Nathan_PionLT_Heep_selection_2021.pdf
94 28 Stephen Kay
** Indicated chosen settings include timings for minimum stats goals
95
** HeeP singles, two spect at some angle/P on one or two settings would be desirable
96
** HeeP delta scan can be done two ways, should ideally do both
97
*** Vary angle
98
*** Vary field
99
** Question from Casey - Current variation for a Heep setting? Would be nice if we can fit it in
100
* Stephen showed and discussed new RFtime hcana class and new MM calculations added to THcSecondaryKine
101
** Both in and working, MM calculation still be tested a little
102
** Pushed to JLab repo
103
* Discussion of remote counting house, still going ahead?
104
** Info given from Brad, but not progressed much further yet (due to financial constraints fitting it into the previous FY)
105
** Garth going to inquire further
106 24 Nathan Heinrich
107
----
108
109 23 Stephen Kay
h2. 2021.04.12 PionLT Software Meeting
110
111
* Discussed HeeP studies further, including event requirements
112
** Clarified that 10k events is the lower limit for singles
113
** 50k events for coin runs
114
* Need to tweak all DEF-cuts files, want *All Events*, can cut out EDTM manually after as needed
115
** Carlos wants to use EDTM events so can't remove them
116
** Ali will need to tweak some cuts accordingly to include a removal of the EDTM events
117
* Stephen highlighted that HeeP physics analysis scripts are in major need of a refresh
118
** Still using old TProof based method, should switch to Python
119
** Need more robust file checking/finding in script too
120
* Garth highlighted that Peter Bosted had made it very clear that the Physics settings where the current was varied were *incredibly* useful
121
** Want to try working some runs like this into the upcoming run plan
122
** Allow us to check FADC efficiencies as fn of rate/current
123
124
----
125
126
h2. 2021.04.05 PionLT Software Meeting
127
128
* I (Stephen) wasn't there so some minutes would be nice!
129
130
----
131
132
h2. 2021.03.29 PionLT Software Meeting
133
134
* Jacob updated on HeeP studies
135
** Fixed rate issues seen previously
136
** Still seeing odd results, can't reconstruct earlier rates
137
*** Factor ~10 out, probably some odd units?
138
* Carlos clarified issues Stephen was having with new Helicity stuff in the replay
139
* Vijay suggested switching to Etottracknorm in some Physics analysis (and including it in the DEF-files)
140
** Should definitely be kept, doesn't make a huge difference for low level analysis though
141
*** Working this into scripts will take a little bit of work, can update it as we go along
142
** Also including Aero X/Y  in all DEF-files now too
143
144
----
145
146 21 Stephen Kay
h2. 2021.03.22 PionLT Software Meeting
147
148
* Casey reported that he had managed to get hcana to compile with root 6.18.00
149
** Stephen mentioned he'd had some conflicts with 6.18.04 - will test 6.18.00 too
150
* Jacob seeing some replayed files with streamer info missing errors
151
** Stephen mentions this is likely just an incomplete or failed replay, if it keeps happening though more info will be needed
152
* Casey reported on some more updates to his timing window scripts
153
** Now work with HMS windows too
154
** Mentioned that Bill Henry is looking at some potentially useful pulse amp plots, useful for other detectors
155
** Pulse int vs timing windows for different detectors and other plots
156
* Stephen gave an overview of upcoming software tasks
157
** Big item on the near horizon is the upcoming second replay of the kaon data, not independent of the pion software work!
158
*** Need updated report files, new efficiencies in the file, new information in the file
159
*** DEF-Files still need updating and cleaning, what can we trim out?
160
*** Which trees do we actually need in each type of replay
161
*** Which types of events should we actually specify -> ALL_Events vs ALL_Events_No_EDTM issue Richard saw recently
162
*** Helicity scalers included now too
163
*** Want to cross check electronic live time multiple ways
164
** A point was raised that we should aim to verify selection cutting in the DEF files yields the same result as post processing the replays with the "same" cuts
165 22 Stephen Kay
** Carlos pointed out that we need to be sure to compare the *exact* same value in our report files and in our data
166 21 Stephen Kay
** Casey requested calibration replay and shell scripts
167
*** Stephen forwarded these on
168
** SHMS Calibration code was not in latest hallc_replay repository
169
*** Casey mentioned Bill Henry hasn't merged it yet, some work is apparently still on going
170
*** Casey is going to follow up on this with Bill as he had some other items to discuss with him too
171
** SIMC comparisons were raised
172
*** Not quite there yet in our analysis, will be coming very soon (within next month or two) though
173
*** Garth mentioned he has a slightly different SIMC branch with different generators available
174
** Need to make sure updates to kaon analysis feed into the pion analysis and vice versa
175
* Garth showed and discussed the latest beam schedule
176
** Long beamtime for PionLT this year
177
** Final part of experiment actually expected to run next year (2022)
178
** Going to be a busy year or two!
179
180
----
181
182 19 Stephen Kay
h2. 2021.03.15 PionLT Software Meeting
183
184
* Replay and Python script running discussion
185
** Git changes, new branch for hallc_replay_lt/UTIL_PION/UTIL_BATCH - _offline_pionlt_
186
*** Need to modify repo setup script, some issues if branch doesn't exist
187
*** Will add instructions on how to get and update new branch
188
*** Will also modify so it automatically checks if the branch exists and gets it if not
189
** Pathing changes for c-pionlt and directory structure now all done, working well
190
** Some issues with replay scripts, both related to hcana updates
191
*** How the pcal_geom file is read in has been changed, variable needs to be VAL, VAL and not VAL VAL (comma instead of space) now
192
*** Helicity stuff no longer working, needed to be commented out for scripts to run
193
*** Carlos mentioned there's a new map for this, will need to update from hallc_replay
194
** Garth raised that Brad was potentially working on an improved GUI for checking online EDTM rates
195
*** Double check/follow up on this?
196
** Discussion of analysis scripts in more detail
197
*** How the MM is calculated, discussed adjusted values
198
*** How CT is calculated for each particle species
199
*** How RF time is utilised in PID
200 20 Stephen Kay
*** Vijay showed RF vs delta and RF vs MM plots and how these can be utilised in PID - "RFvDelta":https://redmine.jlab.org/attachments/download/1200/Kaon_RFtime_delta.pdf, "RFvMM":https://redmine.jlab.org/attachments/download/1201/Kaon_mm_FRtime.pdf, both with Kaon PID cuts applied
201 19 Stephen Kay
*** Stephen will send on some documentation on these topics to Jacob/Julie
202
** To do list for software
203
*** Update hallc_replat_lt with hallc_reply maps
204
*** Install new hcana in c_kaonlt area
205
*** Push all hallc_replay_lt fixes
206
*** Update git script, add instructions
207
208
----
209
210 18 Stephen Kay
h2. 2021.03.08 PionLT Software Meeting
211
212
* HeeP studies discussion
213
** Discussed minimal criteria for singles runs
214
*** No setting shorter than 12 minutes
215
*** No setting longer than one hour
216
*** No setting with less than 10k events
217
*** Want elastics rates of under 100 kHz
218
** Criteria/Discussion for coin runs
219
*** Want roughly 50k elastics
220
*** Multiple would be good
221
*** ~3 hours for one previous setting (at 50% data taking eff), this is OK
222
** Discussed solid angles for each spectrometer
223
*** HMS - 8 mSr, 8.1? 
224
*** SHMS - 3.5 mSr, Carlos states > 4 mSr in his thesis
225
** Both Nathan and Jacob had some spreadsheets with settings analysed, a few numbers did not match previous settings, both looking into this (probably a solid angle off or similar)
226
** Garth sent on Fortran code for cross sections
227
* Analysis Code Updates
228
** Stephen has finalised the pathing/directory structure updates for
229
*** hallc_replay_lt
230
*** UTIL_PION
231
*** UTIL_BATCH
232
** All have a new branch, *offline_pionlt*
233
** Further testing and updates needed, Stephen will work through updating the scripts for the calibrations now that the new structure is set up
234
*** Some are outdated now, DC, Hodoscopes e.t.c (grab wrong DB files to begin with)
235
* Numerous people reported that the farm was very slow over the weekend, if this continues, should raise with Brad/SciComp
236
237
----
238
239 17 Stephen Kay
h2. 2021.03.01 PionLT Software Meeting
240
241
* HeeP studies
242
** Students still working on this, Jacob looking at rate calculations
243
* Stephen - updates on new git and directory setup scripts
244
** Scripts in place but still some work on hallc_replay_lt and UTIL_BATCH needed
245
*** Issues with pathing that need to be corrected for new area
246
*** Should have these finalised by mid/late this week
247
** Jacob has tested and seems to be working OK
248
** Will work on updating/testing DC/Calorimeter calibration scripts next
249
* Jacob conducting sanity checks on new matrix elements, noticed discrepancy between kaonlt/pionlt hcana and previous versions, likely due to changes in hcana from April last year
250
** Mark gave some talk on this last year - "Talk1":https://hallcweb.jlab.org/DocDB/0010/001060/002/update_april2020.pdf , "Talk2":https://hallcweb.jlab.org/DocDB/0010/001055/001/HCANA_Hodo_changes_april2020.pdf, "Talk3":https://hallcweb.jlab.org/DocDB/0010/001056/001/April%202020%20HCANA%20changes%20for%20other%20detectors.pdf
251
* Meeting time discussed, remaining at 13:00 ET (which means it shifts to 11:00 Regina time)
252
 
253 16 Stephen Kay
----
254 1 Stephen Kay
255 16 Stephen Kay
h2. 2021.02.22 PionLT Software Meeting
256
257
* Updates from the group
258
** Garth
259
*** HeeP data discussion, one per beam energy
260
**** KaonLT and PionLT Phase I had nearly every beam energy setting
261
*** Updates about the new target config, phase II and III of PionLT likely going to have new target ladder
262
*** Thicker aluminium cans, CAD design done but not completely finalised, will know soon
263
*** KaonLT beamline will be used in 2021 run, new beamline for 2022 run
264
*** Start of run pushed back slightly, 2022 run will be May to December, PionLT might be slotted into parts of this
265
** Stephen
266
*** Demo2 script fixed, bug was slightly stupid, run not in range but the script did not report this
267
**** Will look at tweaks to kaonlt.py to fix this
268
*** New hcana installed in pionlt area, used root 6.14.04, scons issue with newer root (6.18.04)
269
*** Will create setup scripts for use in migrating over to this area for working
270
*** Minor issue with /cache/c-pionlt directory, permissions related
271
272
* Discussed plans and potential problems for upcoming run regarding COVID procedures, how many people can be on shift, how many people will travel and so on
273
* Will need to shift meeting time in a few weeks due to daylight savings time change for some people
274
275 1 Stephen Kay
----
276
277 14 Stephen Kay
h2. 2021.02.15 PionLT Software Meeting
278
279
* Updates from the group
280 15 Stephen Kay
** Carlos
281
*** Previously looked at optimisation of kinematics for HeeP data
282
*** Document on "DocDB":https://hallcweb.jlab.org/DocDB/0010/001036/002/HC_SoftwareMeeting_Oct03_2019_pdf.pdf
283
*** Will revisit this and try to make some notes on code
284
** Stephen
285
*** No major updates, resolved some issues with scripts Jacob/Junaid were having
286
*** /group/c-pionlt now exists, will try to install hcana here with a more up to date version of root
287
*** Garth mentioned some changes to farm software, cmake, singularity, Jupyter - shouldn't affect us much
288
** Nathan
289
*** Combing hodo script DBase files, will try and update, including batch scripts
290
** Jacob 
291
*** Sanity checks of running old scripts and comparing to new
292
*** Should be in place to combine in new matrix elements soon
293
** Junaid
294
*** demo1 being slow, file probably too large
295
*** Farm also being slow could be an issue
296
** Ali
297
*** Sym link hardcoding, switch location of outputting
298
299
* Idea of a directory setup script, something people can run and it will set up a tree of directories to save files to
300
** Can try making a version of this later this week, will need to modify output of lots of scripts!
301 14 Stephen Kay
302
----
303
304 10 Stephen Kay
h2. 2021.02.08 PionLT Software Meeting
305
306
* Updates from the group
307
** Stephen - Tried to replicate errors Jacob was having with Demo2, could not replicate issues and didn't see any script differences
308
*** May be a versioning issue, Stephen and Richard will investigate further
309
*** JLab environment/root version issue likely cause
310
** Jacob - Questions about the pionlt directories, all but the /group/c-pionlt one seem to be set up
311
*** Stephen following up with Brad on this
312
** Junaid - Some environment issues
313
*** Stephen will try to resolve later today
314
** Casey - Gave an update on his timing window scripts
315
*** https://github.com/mrcmor100/hallc_replay_XEM/tree/timing
316
*** Scripts look very nice, compare timing windows to existing ones and upload plots to network accessible location
317
*** Stephen will take a look at how they can be adapted for our coincidence running
318 13 Stephen Kay
* HeeP running discussion
319 12 Stephen Kay
** Minimum accessible spectrometer angles - SHMS 5.5, HMS 10.5, opening angle ??
320
** Want higher for HeeP running for practicality (no hall access e.t.c.)
321 10 Stephen Kay
322
----
323
324 3 Garth Huber
h2. 2021.02.01 PionLT Software Meeting
325 2 Stephen Kay
 
326
* Updates from the group
327
** Stephen - Cointime peak script updates and fixes
328
** Jacob - Issues with Demo2 cuts
329
*** Stephen thinks this may be due to lack of updating of the script after some changes Richard made, will investigate
330
** Nathan - Hodoscope script issues, tracked down to .database file. Investigating fixes
331
** Junaid - Software setup on Lark but python/root issues here, working on JLab account. Will investigate root compilation on Lark
332
*** Stephen raised that issue in getting root to compile isn't actually related to the python version used, other package/component causing issues
333
** Ali - Working on improving report files and def files
334
* "Casey Presentation":https://redmine.jlab.org/attachments/download/1175/pionLTgroup_presentation.pptx
335
** Discussion of process and software used by XEM experiment
336
** Nice reference time script in place, will exchange with Stephen/Richard and see what can be merged with each
337
** Structure and plan for analysis look similar to our own, will try to collaborate as much as possible on having a nice working set of software for online usage
338
** Raised point of online BCM/BPM monitoring
339
*** Dave mentioned it would be nice to track the stability of the BCM/BPMs over the run period, at least once per shift produce a plot/document checking this
340
*** Stephen added that this could also track the prescale factors (reported vs calculated)
341
*** Investigate idea of a once per shift script that checks last X runs and produces plots above
342
343
----
344 1 Stephen Kay
345 3 Garth Huber
h2. 2021.01.25 PionLT Preparation Meeting
346
347
* Garth Discussed run plan kinematics, purpose of Heep runs, and Luminosity scans
348
** Homework: students should look at distributed Heep kinematics and try to find some sets of singles (e') and coin (e'+p) runs which would overlap either in energy or angle with the physics kinematics, for the purpose of establishing angle and momentum offsets.
349
** Jacob also looked through Garth's physics kinematics spreadsheet, and did not find any additional errors, beyond the one GH had already identified.  That error turned out to be an error in the kinematics table in the Jeopardy (2019) proposal, and GH subsequently distributed a corrected spreadsheet.
350 4 Garth Huber
[[https://redmine.jlab.org/attachments/download/1176/pion_runplan_21jan26.ods]]
351 5 Garth Huber
[[https://redmine.jlab.org/attachments/download/1178/elas_9p900gev.out]]
352 6 Garth Huber
[[https://redmine.jlab.org/attachments/download/1179/elas_9p200gev.out]]
353 7 Garth Huber
[[https://redmine.jlab.org/attachments/download/1180/elas_8p000gev.out]]
354 8 Garth Huber
[[https://redmine.jlab.org/attachments/download/1182/elas_6p000gev.out]]
355 6 Garth Huber
356 9 Garth Huber
----
357
358 3 Garth Huber
h2. 2021.01.12 PionLT Software Meeting
359 1 Stephen Kay
 
360
* "Stephen Presentation":https://redmine.jlab.org/documents/122
361
** Discussion of analysis tasks and status as of 12/01/21. The non-annotated version of the notes is also available "here":https://redmine.jlab.org/documents/123
362
** Homework for next week is the following -
363
*** Setup and try the batch calibration scripts and the python analysis script demo
364 6 Garth Huber
*** For Stephen - Check with Brad regarding new area for files