Project

General

Profile

Daily Reports » History » Version 26

Jixie Zhang, 01/19/2021 06:59 AM

1 1 Xiaochao Zheng
h1. Daily Reports
2
3 24 Xiaochao Zheng
*run plan document on [[https://docs.google.com/document/d/1Bmag_YPrl1szxLhYyA4eLUP2PV_pM0x51pHbeCj2hL4/edit?usp=sharing]]*
4 21 Xiaochao Zheng
5 26 Jixie Zhang
*daily report 1/19/2021 -- by Jixie*
6 25 Jixie Zhang
7
8 26 Jixie Zhang
*daily report 1/18/2021 -- by Jixie*
9 1 Xiaochao Zheng
10 26 Jixie Zhang
# Finished taking 12 GeV data including calibration data(903,904,905). Run range is 867-905
11
# Started taking 16 GeV data. HVs for this energy were determined. We plan to take 12 hours of data, plus 1 hour calibration. 
12
# Calibration data for 16 GeV are ready(run 924-929). 
13
# Requested MCR to control the beam spot size to 6 cm diameter. After that we determine the new coordinate of the center of the 3 Ecal modules.
14 1 Xiaochao Zheng
15 26 Jixie Zhang
*daily report 1/17/2021 -- by Jixie*
16 1 Xiaochao Zheng
17 26 Jixie Zhang
# Automation on logentry works now. More and more analysis scripts are ready to use
18
# Finished taking 6 GeV data, run number range is 848 - 866
19
# All beam energy of <=8 GeV will use 8GeV HV setting. Finihsed taking calibration data (run 853,854,855) for this setting.  
20
# 16 GeV beam is available, and its trigger rate can reach 15K per spill, which is almost 10 times at all lower energies. We could not take this beam energy until a 3rd HV module is set up. 
21
# Started taking 12 GeV data from ~2PM. The plan is to take 24 hours of data, plus 2 hours of calibration data. 
22
# Motion table position is optimized to let the beam hit the center of 3 blocks.
23
# scripts for backing up data and transfer data to JLab volitile is ready. Data will be backed up several time a day.
24
25 1 Xiaochao Zheng
*daily report 1/16/2021 -- by Jixie*
26
27 26 Jixie Zhang
# Beam energy scan was finished on Jan 15, HV for each beam energy are determined 
28
# Finished 24 hours of 1 GeV data taking using 8GeV HV setting. We forgot to change it back. Since detector is not saturated, do not bother to change it. Run number range is 823 - 847.
29
# Start 6 GeV data taking by run number 848. Plan to take 18 hours of data.
30
# Working on making automatic start|end of run log entry.  
31
# MWPC decoder and analysis program works. beam spot size is huge (9cm x 8 cm). 
32
33 21 Xiaochao Zheng
*daily report 1/15/2021 -- by Xiaochao from far away*
34
35
# good gracious, we keep getting 24 hours a day
36 22 Xiaochao Zheng
# we should keep our dialy work hours below 16 and stretch shifts to 8 hours  
37
# rate scan is done up to 12 GeV energy. And we are now taking 1 GeV data
38
# the trigger is from FTBF's 3 scintillator paddles coincidence with the spill signal. FTBF's 2-chamber Cherenkov signals are not in the trigger but are in our FADCs.
39
# MWPC has problems: 1 was fixed today (hardware) and both are working and online, daq is working and synced with our daq. But the software is missing a library so we can't decode the data. 
40 1 Xiaochao Zheng
# According to David's post on Slack:
41 23 Xiaochao Zheng
42
> David Flay 2:20 PM
43
> ok, using the rates above, I find for our remaining 11 days:
44
> 2:20
45
> E = 12.0 GeV, numShifts = 1.3, totEvt = 16356343
46
> E = 10.0 GeV, numShifts = 0.8, totEvt = 16356343
47
> E = 8.0 GeV, numShifts = 0.7, totEvt = 16356343
48
> E = 6.0 GeV, numShifts = 0.8, totEvt = 16356343
49
> E = 1.0 GeV, numShifts = 14.7, totEvt = 16356343
50
> E = 2.0 GeV, numShifts = 2.5, totEvt = 16356343
51
> E = 4.0 GeV, numShifts = 1.2, totEvt = 16356343
52
> 2:21
53
> clearly that 14.7 shifts doesn’t make sense.
54
> David Flay 2:27 PM
55
> I think it checks out;
56
> 2:27
57
> Total time: 264.0 hrs
58
> E = 12.0 GeV, weight = 0.061, time = 16.1 hrs, numShifts = 1.3, totEvt = 16356343
59
> E = 10.0 GeV, weight = 0.038, time = 10.0 hrs, numShifts = 0.8, totEvt = 16356343
60
> E = 8.0 GeV, weight = 0.032, time = 8.5 hrs, numShifts = 0.7, totEvt = 16356343
61
> E = 6.0 GeV, weight = 0.038, time = 9.9 hrs, numShifts = 0.8, totEvt = 16356343
62
> E = 1.0 GeV, weight = 0.666, time = 175.9 hrs, numShifts = 14.7, totEvt = 16356343
63
> E = 2.0 GeV, weight = 0.112, time = 29.5 hrs, numShifts = 2.5, totEvt = 16356343
64
> E = 4.0 GeV, weight = 0.053, time = 14.0 hrs, numShifts = 1.2, totEvt = 16356343
65
> Totals:
66
> Time = 264.0 hrs
67 1 Xiaochao Zheng
> Shifts = 22.0
68 21 Xiaochao Zheng
> 
69 20 Xiaochao Zheng
70
*daily report 1/14/2021 -- by Xiaochao from far away*
71
# beam started sometime in the evening. 
72
# we got the night time beam as a bonus - the other group does not need it - causing us to scramble the shift schedule. Paul Reimer came in for the night shift, until 3am - thanks!
73
# by midnight, we are sending beam to center of each block, trying to adjust HV/gain-match;
74 26 Jixie Zhang
# Jixie adjusted Cherenkov pressure around 10pm. Previously the two chambers were set at 4.0 and 0.2 psia, respectively. I think Jixie lowered one of them from 4.0 to 0.8
75 20 Xiaochao Zheng
76
_To do:_
77
# complete gain/HV-matching of the 3 shashlyk modules
78
# center beam at the middle of the 3-block (a little off-center may be ideal, better than at the exact center) and do energy scan over night to figure out rates
79
# David will rework the runplan during the day
80
# One of the MWPC is broken, will be installed during the day
81 1 Xiaochao Zheng
82
*Jixie  9:04 PM
83
daily report 1/13/2021*
84
A busy and tired day! At least our DAQ is ready to take beam with our own trigger!
85
# Start installation from 7AM. Finished installing detectors and cabling by 1PM
86
# Put the rack in the control room so no access needed for daq work. Our daq machines are also in the control room.
87
# David came to site. Help a lot in setting up computers. Xinzhan and I are working on detectors and daq cabling. Both desktops are online. CODA runs well.
88
# Operational Readiness Clearance (ORC) meeting started from 1 PM. Detectors are all good. However, JLab made VME cards were suggested to change fuse at the beginning...... After some long negotiation, we were requested to put kapton tape to cover the power interface. We also received some suggestions to run the experiment safely. We might get all signature by tomorrow
89
# We connected HV and signal cables to the patch panel. All PMT signals have been checked using an oscilloscope. All detectors work well. We do not have enough time to modify daq to take the FTBF trigger. FTBF has 3 channels for Cherenkov, none of them add into our FADC yet. (Need to find cable and do fan in fan out...) MWPC daq does not have a veto input, it can not take our busy status immediately. We have to form a new trigger then feed it. We will do this in the morning of Thursday.
90
# Accelerator is down. One magnet is not functioning. They are waiting for the radiation to cool down so they can fix it tomorrow morning. Beam might be available in the afternoon.
91
92
_To do:_
93
# Do FTBF controlled access leader training in Thursday morning 9AM
94
# MWPC daq is a well integrated machine (looks like a laptop). It does not provide L1A signal. We need to learn deep about this system to find out a possible way to take thrit L1A. We will then veto it using out busy status. Need to spend time here Thursday.
95
# connect cherenkov into our FADC.
96
97 2 Alexandre Camsonne
Pictures under useful pictures with prefix 20200113_xx
98 8 Alexandre Camsonne
99 12 Xiaochao Zheng
100 1 Xiaochao Zheng
!{width:20%}https://redmine.jlab.org/attachments/download/1159/IMG_20210113_085123.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1160/IMG_20210113_160026.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1161/IMG_20210113_141747.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1162/IMG_20210113_141726.jpg! 
101 13 Xiaochao Zheng
102 12 Xiaochao Zheng
!{width:20%}https://redmine.jlab.org/attachments/download/1163/IMG_20210113_121019.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1164/IMG_20210113_120704.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1165/IMG_20210113_120825.jpg! 
103 13 Xiaochao Zheng
104 9 Xiaochao Zheng
!{width:20%}https://redmine.jlab.org/attachments/download/1166/IMG_20210113_120735.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1167/IMG_20210113_115807.jpg! !{width:20%}https://redmine.jlab.org/attachments/download/1168/IMG_20210113_090032.jpg! 
105
106
*Jixie  8:02 PM daily update 1/12/2021*
107
# Took radiation practical training, both of Jixie and Xinzhan
108
# Met Lorenzo, have a long and deep conversation with him. He helped us setting up the gateway machine, which is soliddaq. Right now solidaq has 2 network interfaces, one of them is borrowed from FTBF.  soliddaq can access the public network, it also serves as the gateway of the private network. Because IP forward function is not enabled, right now private network members can not access public networks yet. (I need help from an expert to enable this.)
109
# If you want to access to clrlpc, you have to access to solidaq using fermilab linux account, then ssh from soliddaq into clrlpc using a-compton account. If you want to do that, send me your fermilab username. I can add your username into the name lists that allows you to login soliddaq using a-compton account.
110
# David brought the hard drive and pcie to usb3.1 convert card here. Two 5T hard drive (2.5") were installed into the usb hub provided by Alex. Tested the data transfer speed. It can reach 130MB/s when the CPU is idle. Data transfer speed changes a lot when coda is running. 
111
# JLab experts are working on DSC issues. The Fan-In-Fan-out module degrades the input signal too much, which is part of the reason that DSC lost signal.  We borrowed one from FTBF.  JLab experts are also checking and fixing the software.  Right now we can see TDC in the output file. Alex is still working on it to make sure it does not lose data.
112
# David is working on ORC form.
113
       
114
_Here is how we transfer data back to jlab:_
115
# make a copy of data into soliddaq, this copy will also be our backup of all raw data
116 10 Xiaochao Zheng
# sent data from soliddaq to jlab
117 9 Xiaochao Zheng
118
_To Do:_
119
# The beam will be off by 6AM Wednesday. We will start installation from 7 AM. We aim to finish cabling and installation by 1 PM.
120
# ROC inspection is scheduled at 1 PM Wednesday. I will show in person. David will join remotely.
121 14 Xiaochao Zheng
# The beam is scheduled to be delivered by 5:30 PM.  Look forward to taking beam! (edited) 
122
123
124
125
*Jixie  9:03 PM daily report, 1/11/2021*
126
# Put all our computers into a private network switch, use ip 192.168.1.x, reserve IP 192.168.1.1 for the gateway. All computers can talk to each other. Still waiting for FTBF to provide a gateway. Talked to Evan and Lorenzo. They understanded our request and will set up one tomorrow.
127
# Rebooted vme crate.. The hostname 'intelvmeha8' came back. Start and stop coda smoothly, no need to manually start ROC2.
128
# DSC did not write data to the output file. Experts at Jlab are working on this.
129
# Talked to Evan about MWPC daq. Learned that we can easily take their trigger, which is SC1&SC2 (both stay at FTBF beam line). We decided to take the L1A signal from MWPC daq to be our trigger. In this way the events from our daq are already synchronized with MWPC daq. We will also put our SCs into the FADC, they just do not serve as triggers anymore. We will also plug Cherenkov signal into our FADC. We will also put a copy of MWPC daq's L1A into our TDC.
130
# David is preparing the ORC document
131
# Had a meeting with Lorenzo, we agreed to start shift at 8 AM|PM.
132
# install kerberos kit in clrlpc. We will not use it during data taking but can use it if needed. Only people with a Fermilab linux account can access it.
133
# taped the lead block.
134
135
_ To Do:_
136
# get a gateway
137
# solve DSC
138
# look at raw data file of MWPC daq, try to understand their daq
139
140 15 Xiaochao Zheng
141 14 Xiaochao Zheng
*Jixie  10:15 PM daily report 1/10/2021*
142
# pause daq data taking to test 3 preshowers.  They are all good
143
# continued testing TDC  configuration. Looked at TDC signal in raw data file.   improving/updating coda and decode program under the guidance of Alex.
144
# taking cosmic data.  right now daq machine clrlpc is offline
145
146
_To Do:_
147
# finish setting up private network
148
# tape the lead block
149
# practice sending data back to jlab
150 16 Xiaochao Zheng
# take training on Tuesday
151 17 Xiaochao Zheng
152
*Jixie  6:59 PM daily report 1/9/2021*
153
# Finished installing kerberos kit into soliddaq desktop (the backup one)
154
# zoom meeting with Alex, we are now able to run coda only if we do not follow Fermilab kerberos ssh requirements. A trick is that we used jlab configuration to start coda and all rocs, when coda runs we switch to fermilab configuration. This is not a solution! We have to put daq into a private network.
155
# Found a 1000Mbps switch and several cat5e cables. Cat5e cable's speed can reach 1000 Mbps, while cat6's is 10Gbps. Will be better if there are enough cat6 cables. Plug 2 laptops into the switch, manually specify IP and gateway, 2 laptops can talk to each other. I tried to set up my laptop (windows10) as the gateway and using WIFI to connect to the fermilab public network. Failed!
156
157
Our solution will be: soliddaq, clrlpc, intelvmeha8 will be in a private network.
158
* Ask Fermilab to provide a gateway. (The backup daq machine must be identical to the main daq machine.
159
* To transfer data to JLab, I will send data using the backup daq to Jlab work disk.
160
* Alex, please help me to find out which disk I can write raw data to, total space no more than 14T.
161
162
_To Do:_
163
# Request FTBF to provide a gateway, finish setting up the private network
164
# CODA roc2 need to be start manually, need to fix that
165
# work out a script to transfer data
166
# waiting for HA approval then tape the lead
167 18 Xiaochao Zheng
# test preshowers when a 2nd HV module is available. (edited) 
168
169
170
*Jixie  10:22 PM daily update 1/8/2021*
171
# both desktops got blocked because password authority is not allowed.   Solved it  after reconfigured sshd_config file.
172
# applied host principles for both desktops.  Got password in the afternoon but have typed a wrong host name for the main daq machine.  Reapplied and now waiting for supervisor's approval. The backup machine (soliddaq) is ready to install kerberos kit but do not have time to do it.
173
# connected daq system.  hooked SCs and Ecals into daq.  viewed trigger signals.  ready to take cosmic data.  Preshowers are not connected yet.
174
# hooked vme directly to clrlpc,  configured them to talk to each other.  2 machines can talk now.
175
# Alex helped thought zoom meeting.  After some modifications,  Alex can run coda to take events.  But I could not run it by myself because some configuration changes that  Alex did might not be saved.
176
# Paul came to help.  We are trying to solve the network issue.   Desktop clrlpc has a puppet service to overwrite sshd_config frequently.  Therefore all my modifications is gone.  We have to solve it ASAP otherwise this machine will be blocked again once the Fermilab robot catches it.
177
Service puppet was temporary disabled. 
178
# Rearranged detectors such that 2 SCs and Ecals are in the same line.
179
#  My laptop got blocked due to use X11 service......
180
181
_To Do:_
182
# Install kerberos kit
183
# configure coda
184
# test preshowers
185 19 Xiaochao Zheng
# tape the lead plate (edited) 
186
187
*Jixie  8:42 PM daily report 1/7/2021*
188
# installed both the nim and the vme crates onto a movable rack
189
# learned how to use FTBF's HV module.  This module can only supply HV in range from the set point subtract 580V  to the set point.  For example,  If a set point is 2500V,  the HV range is 1920-2500.  In our case,  we need to set ecal at 900V,  SC at 1300V, and preshowers at 2100V.  We have to use two HV module.
190
# We look at the signals for all 3 ecal and 2 SC.  We didn't damage them during the bumpy driving.  The signals looks good.
191
# We installed 3 ecal modules into the tray. Carefully addjust their positions to make sure them attach to each other tightly.
192
# registered both desktops, clrlpc and soliddaq, to Fermilab public network.  The latter is a back up for daq machine.   Both of them are now online.   If you have a computer account of Fermilab,  you can ssh to it using account a-compton.
193
194
_To do:_
195
# test preshower detectors
196
# applying a computer account so I can access daq machine from apartment
197
# connect daq system to detectors
198 1 Xiaochao Zheng
# tape the lead plate after HA got approved (edited)