Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision 		Previous revision
Next revision Both sides next revision
daq:daq [2013/04/05 11:34]
noji 		daq:daq [2022/07/14 14:43]
weisshaa [This is DAQ page for the 2015 campaign]
Line 1: Line 1:
-====== ​Look Up table 4/​3/​2013-- ​======+======= ​New in 2022 ====== 
 +start run window is obsolete. Two scripts are available for changing the data directory. Daq needs to be stopped, directories need to exist:  
 +  * changeDataDir_maintainRunNum ​ <data dir> ​ : keeps the Run number the same, for when we need to move physics experiment data collection to another disk 
 +  * changeDataDir_resetRunNum <data dir> ​ : finds the lowest available Run number without any larger RunDir #s
  
-^  Spectcl ​ ^  CRY id  ^  Qp  ^ 
-^  00  |  26  |  Q2p3  | 
-^  01  |  30  |  Q6p3  | 
-^  02  |  25  |  Q2p2  | 
-^  03  |  29  |  Q6p2  | 
-^  04  |  27  |  Q2p4  | 
-^  05  |  31  |  Q6p4  | 
-^  06  |  24  |  Q2p1  | 
-^  07  |  28  |  Q6p1  | 
-^  08  |  47  |  Q5p4  | 
-^  09  |  51  |  Q4p4  | 
-^  10  |  59  |  Q3p4  | 
-^  11  |  63  |  Q1p4  | 
-^  12  |  44  |  Q5p1  | 
-^  13  |  50  |  Q4p3  | 
-^  14  |  38  |  Q3p3  | 
-^  15  |  60  |  Q1p1  | 
-^  16  |  46  |  Q5p3  | 
-^  17  |  48  |  Q4p1  | 
-^  18  |  56  |  Q3p1  | 
-^  19  |  62  |  Q1p3  | 
-^  20  |  45  |  Q5p2  | 
-^  21  |  49  |  Q4p2  | 
-^  22  |  57  |  Q3p2  | 
-^  23  |  61  |  Q1p2  | 
-^  24  |  88  |  Q7p1  | 
-^  25  |  91  |  Q7p4  | 
-^  26  |  89  |  Q7p2  | 
-^  27  |  90  |  Q7p3  | 
  
-====== Look Up table 7/​19/​2012--4/​1/​2013 ======== 
  
-^  Spectcl ​ ^  CRY id  ^  Qp  ^  +======= This is DAQ page from previous campaigns ====== 
-^  00  | 26 | ​ Q2p3  | +The DAQ page from the former S800-GRETINA campaign in 2012 can be found at 
-^  01  |  30  |  Q6p3  | +https://​wikihost.nscl.msu.edu/​gretina/​doku.php/​daq:​daq_2012
-^  02  |  34  |  Q4p3  | +
-^  03  |  38  |  Q5p3  | +
-^  04  |  25  |  Q2p2  | +
-^  05  |  29  |  Q6p2  | +
-^  06  |  33  |  Q4p2  | +
-^  07  |  37  |  Q5p2  | +
-^  08  |  27  |  Q2p4  | +
-^  09  |  31  |  Q6p4  | +
-^  10  |  35  |  Q4p4  | +
-^  11  |  39  |  Q5p4  | +
-^  12  |  24  |  Q2p1  | +
-^  13  |  28  |  Q6p1  | +
-^  14  |  32  |  Q4p1  | +
-^  15  |  36  |  Q5p1  | +
-^  16  |  63  |  Q1p4  | +
-^  17  |  67  |  Q3p4  | +
-^  18  |  71  |  Q7p4  | +
-^  19  |  60  |  Q1p1  | +
-^  20  |  66  |  Q3p3  | +
-^  21  |  68  |  Q7p1  | +
-^  22  |  62  |  Q1p3  | +
-^  23  |  64  |  Q3p1  | +
-^  24  |  70  |  Q7p3  | +
-^  25  |  61  |  Q1p2  | +
-^  26  |  65  |  Q3p2  | +
-^  27  |  69  |  Q7p2  |+
  
 +  * S800-Gretina control [[docsS800Grt|docsS800Grt]] ​
 +  * {{ :​daq:​ulm-e16011_names.png?​linkonly |S800 Trigger GUI}}
 +======= Troubleshoot ======
 +  * S800-Gretina not correlated: Check CC setfile ~s800/​converged_daq/​Scripts/​CC0105Begin.tcl for extsynch and extclock
 +  * S800 is losing events. Check the network speed of spdaq45 by /​sbin/​ethtool eth0 and /​sbin/​ethtool eth1 , both should show speed as 1000Mb/s, if one shows 100Mb/s then the network is too slow and S800 cannot send data to GEB fast enough which will cause event loss happen.
 +  * Check the ringbuffer status, $DAQBIN/​ringbuffer status - -host=spdaq45 - -all , if the free colum becomes zero, DAQ related people needs to be notified for diagnostics.
  
-GRETINA DAQ system+======= Decomp Information ====== 
 +  * [[easy_decomp_calibrations|Easy Gretina Decomp File Creation]] 
 +  * [[decomp_calibrations|Gretina Decomp Calibrations Explanation]]
  
-====== ​HowTo for experimenter in charge ​========+======= ​Gretina Computing ​======= 
 +Gretina computer farm is maintained by LBNL computer group and local NSCL IT department. Nonetheless I put documents here, but we do NOT do anything to the GRETINA computers!
  
-  * Online SpecTcl [[:​onlinespectcl|onlinespectcl]] 
  
-====== Changelog ======== +  * May 2019, documentation provided from Jackie: [[https://​docs.google.com/​document/​d/​1Aq5NkuEKBc4_5fx-95d2RaSZM08VQwVleYWr42QTsFg/​edit?​invite=CNr_nogM&​ts=5cd488d9|Gretina System Documentation]] 
-ANY change ​to the DAQ system out here: [[:daqchange|daqchange]]+  * Instruction ​to shut down switches for NSCL power shutdown 12/5/2015 {{:daq:gretinaswitchesshutdown.pdf|}}
  
-**NOTE**: No change pass July 13th 2012 can be done without explicit +======= NSCL GRETINA LaBr Array =======
-announcement and approval (by Dirk). ​+
  
 +    * [[fastscint_daq| FastScint DAQ Quick Start]]
 +    * [[fastscint_daq_long | FastScint DAQ Details]]
  
-====== issues ​======== +======= ​Misc 2019 ====== 
-ANY issue/​breakdown put here: [[:​daqtrouble|daqtrouble]]+  * Dual homed NSCL machines are spdaq32 and spdaq45
  
 +====== miscellaneous ======
 +  * Validation/​Trigger window width is set by Dig116_CS_X55WidthP,​ Dig116_CS_X55WidthN. N/P stands for positive/​negative maximum difference relative to Trigger timestamp which will be read out.
 +  * Bringing up just the EPICs screen: in gretina home **./​startGRETINA_EPICSdisplay**
 +  * Set trigger multiplicity:​ **caput Trig0_CS_FSCThr n** (n=0,​1,​2,​3... for mult 1,2,3,4...)
 +  * See trigger pulse width: **CheckLED.sh**  ​
 +  * Change trigger pulse width: **SETLEDWIN <# of 20ns ticks>**
 +  * Check timestamps, report boards that are out-of-sync:​ **CheckTS**
 +  * Force timestamps to reset, DO NOT USE DURING RUN!!!: **SINGLEIMPSYNC**
 +  * Warning script: run on a2 as gretina in ~/scripts: **./​warningMessage4.sh **
 +  * Check decomp stats  ** recordDecomp.sh | head -n50 **
 +  * [[Flash digitizer firmware]]
 +  * Check digitizer firmware version: on a2 or a1 terminal, type: **DIGSNIDFW** ,all digitizers should have same version firmware
 +  * [[Replace digitizer with different color ones]]
 +  * [[Replace fuses of digitizer]]
 +  * [[No valid decomposed events]]
 +  * Verify connecedt digitizers, at IOC interface, type **dbior**, it will print all identified digitizers within one bank
 +  * VME related scripts are located at /​global/​devel/​boot/​vmeArray
 +  * Check connected PVs, at IOC interface, type "​casr"​
 +  * [[ Move detectors to new Hole position ]]
  
-ReadOutShell reports "S800 changed to inactive"​ [[:​ReadOutShellS800Inactive|ReadOutShellS800Inactive]] +====== ​Reboot a2 ====== 
- +  * If a2 is rebooted due to system failure, two scripts need to be brought up 
-====== ​start procedures ​====== +    * from ~gretina: ​nohup scripts/warningMessage4.sh & 
- +    ​* from ~gretina/scripts/watcherdir: nohup watcher & 
-  * [[GRETINA:​GRETINA]] + ​The ​first is the alarm script that talks to users.  The second ​is responsible for two things: writing record{Counters,​Decomp,​Settings} ​in the current run directory ​and cleaning up cluster process issues ​(usually restarting broken processes) soon after starting ​or stopping runs.
-  *[[s800daq:​s800daq]] +
-  *[[source measurement:​source measurement]] +
-  * S800 monitor [[https://​groups.nscl.msu.edu/​opdevtech/​wiki/​index.php/​S800_DAQ_status_tool|S800mon]] +
- +
-====== Documentation ====== +
-  * NSCL DAQ general [[http://​docs.nscl.msu.edu/​daq]] +
-  * NSCL DAQ GRETINA (ReadOutShell scheme) [[http://​docs.nscl.msu.edu/​daq/​gretinauserdocs.pdf]] +
-  * S800 DAQ [[https://​groups.nscl.msu.edu/​opdevtech/​wiki/​index.php/​Main_Page#​Electronics_and_DAQ]] +
- +
-====== Trigger connection ====== +
- +
-  * [[daq:​triggerconnection|Trigger connection (Card 29)]] +
- +
- +
-====== Status ====== +
-[[:​status|status]] +
- +
- +
- +
-==== Files/trees on GRETINA cluster ​to go ==== +
-(Only to be done by Dirk) +
- +
-   /​global/​data1x/​gretina: ​ +
-   ​drwxrwxr-x ​ 64 gretina users  4096 Sep 19  2011 CR-1 +
-   ​drwxrwxr-x 528 gretina users 20480 Oct  4  2011 CR-2 +
-   ​drwxrwxr-x ​ 12 gretina users  4096 Nov 16  2011 CR-5 +
-    +
-   /global/​data1b/​gretina +
-   2.7T CR-9 +
- +
-==== File Structure on GRETINA cluster / files to be kept ==== +
- +
-   Here offline decomp data gets stored: +
-    ​/​global/​data1a/​gretina/user1 +
-    ​/global/​data1a/​gretina/​user2 +
-    /​global/​data1a/​gretina/​user2_1 +
-    /​global/​data1a/​gretina/​user4 +
- +
-   Base + data to create them: +
-   /​global/​data1a/​ +
-   ​drwxrwxrwx ​ 8 mario   ​bin ​  4096 Mar 27 12:52 q1a1 +
-   ​drwxr-xr-x ​ 6 mario   ​bin ​  4096 Nov 24  2010 q1a3 +
-   ​drwxrwxrwx ​ 9 mario   ​bin ​  4096 Mar 27 12:53 q1b1 +
-   ​drwxr-xr-x ​ 7 mario   ​bin ​  4096 Mar 27 12:53 q1b2 +
-   ​drwxr-xr-x ​ 9 mario   ​bin ​  4096 Mar 27 12:55 q2a5 +
-   ​drwxr-xr-x ​ 9 mario   ​bin ​  4096 Mar 27 12:57 q2a6 +
-   ​drwxrwxrwx ​ 7 mkp     ​bin ​  4096 Mar 27 13:01 q2b4 +
-   ​drwxr-xr-x ​ 7 mkp     ​bin ​  4096 Mar 27 13:03 q2b6 +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 13:05 q3a14 +
-   ​drwxr-xr-x ​ 6 mario   ​bin ​  4096 Mar 27 13:06 q3a7 +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 13:08 q4a4 +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 13:09 q4a8 +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 13:11 q4b7 +
-   ​drwxr-xr-x ​ 6 mario   ​bin ​  4096 Mar 29 14:00 q4b8 +
-   /​global/​data1b/​ +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 14:26 q3b14 +
-   ​drwxr-xr-x ​ 5 mario   ​bin ​  4096 Mar 27 14:27 q3b5 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar  6 18:07 q5a10 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar  6 18:17 q5a12 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar  7 13:14 q5b10 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar  6 18:27 q5b3 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar 27 14:29 q6a15 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar 27 14:29 q6a3 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Jun 10  2011 q6b11 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Jun 10  2011 q6b9 +
-   ​drwxr-xr-x ​ 3 gretina bin   4096 Mar 27 14:31 q7a11 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar 27 14:32 q7a9 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar 27 14:33 q7b13 +
-   ​drwxr-xr-x ​ 5 gretina bin   4096 Mar 27 14:33 q7b15 +
-   ​384G DNLapril2012: ​  DNL data of digitizers +
- +
-====== Configuration files for decompostion ====== +
-The configuration for the decomposition ​is here: https://​wikihost.nscl.msu.edu/​gretina/​doku.php/​daq:​decomp +
- +
-====== Positioning of the quads ====== +
-When a position of a detector is changed the following has to be updated: +
-  * CS_DataId in https://​wikihost.nscl.msu.edu/​gretina/​doku.php/​daq:​decomp +
-  * CS_GblId in /​global/​devel/​boot/​vmeArray/​vme*.cmd --- The Id is given by  hole_number * 16 + position_in_quad * 4 + board_number +
-  * GTSort_shack/​DetNum.dat --- self explanatory +
- +
-====== How to replace a broken node with a spare one ====== +
-To replace a node of the cluster (e.g. n000x) with a spare one (e.g. n000y) follow the following procedure: +
-In the file /​global/​devel/​gretTop/​11-1/​gretClust/​bin/​linux-x86/​setup7modulesRaw.sh and in the file /​global/​devel/​gretTop/​11-1/​gretClust/​bin/​linux-x86/​setupEndtoEnd28.sh +
-  * replace node000x_CS_Program?​ with node000y_CS_Program?​ +
-  * from the "​GRETINA CLUSTER node allocation"​ window identify the name of the Decomp ​process (middle click on the crystal number) and replace it in the files +
-  * change the n000x to offline ​and the n000y to online using the variables Decomp???​_CS_Enable +
- +
- +
-====== DAQ cold restart ====== +
-  * Switch off all the vme crates. +
-  * wait 30 s +
-  * Switch on the vme crate of the trigger cards. +
-  * wait till the red lights over the trigger board are on (~ 3 minutes) +
-  * Switch on all the other vme crates +
-  * wait till the green blinking lights appears on all the digitizers (~ 3 minutes) +
-  * start the daq and check the synchronization (alarm window ​or TS window). If few of the digitizers are out of sync recover them using the "​reboot IOCs button",​ otherwise power-cycle on their crate+
  
 +  * Switch to a1
 +    * If a2 cannot be brought back. Gretina DAQ can still run on a1. In the file ~/.profile , environment variable **DAQSERVER** needs changed to be a1.gam . This parameter is used to restrict gretina daq critical scripts to run on specific machine.

Trace:

QR Code
QR Code daq:daq (generated for current page)