Home
South Pole Logbook

Search below for 'logbook_sop' for help on usage.

Sections

Search

Archives

November 2009
Sun Mon Tue Wed Thu Fri Sat
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30          

RSS Feed

Powered by Blosxom


Root :: Ice Cube :: Runs :: { RCAs }

Nov 02, 2009

DSB board swapped on ichub59

at 2:20am we had an alarm: 
 command /mnt/data/testdaq/bin/domhub ic59 quickstatus
 monitor v2.210000
 Error Summary
 [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 0 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 1 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 1 dom B [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 2 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 2 dom B [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 3 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=13301d13301d; GPS/DSB Problem? The dom is: card 0 pair 3 dom B [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=257a4e257a4e; GPS/DSB Problem? The dom is: card 1 pair 0 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=257a4e257a4e; GPS/DSB Problem? The dom is: card 1 pair 1 dom A [E   1] >>> sps-ichub59 : Duplicate doms w/ MBID=257a4e257a4e; GPS/DSB Problem? The dom is: card 1 pair 1 dom B [E   1] >>> sps-ichub59 : No more identical mainboard ids will be reported for this hub
At 4:00am one WO received the page an restarted the aquisition without ichub59 until 10:00am. 
DAQRun [2009-11-02 15:05:22.590826] Version info: DAQRun.py 4161 2009-05-19 01:41:26Z dglo Delfina 2644:4661
DAQRun [2009-11-02 15:05:22.590972] Starting run 114744...
DAQRun [2009-11-02 15:05:22.591038] Run configuration: sps-IC59-Discworld-and-Corporal-Whitcomb-tweaks-V104-no59
DAQRun [2009-11-02 15:05:22.591107] Cluster configuration: ic59-it8-tb2-no-amanda.xml
DAQRun [2009-11-02 15:06:13.947064] Started run 114744 on run set 1
DAQRun [2009-11-02 15:06:14.720924]     0 physics events (0.00 Hz), 104428 moni events, 4313 SN events, 323 tcals
DAQRun [2009-11-02 15:07:14.324226]     111293 physics events (1756.09 Hz), 4035950 moni events, 218843 SN events, 20841 tcals
DAQRun [2009-11-02 15:08:14.332234]     222784 physics events (1805.63 Hz), 4307352 moni events, 433772 SN events, 41888 tcals
DAQRun [2009-11-02 15:09:14.360884]     335471 physics events (1829.06 Hz), 4580511 moni events, 649027 SN events, 62846 tcals
DAQRun [2009-11-02 15:10:14.593834]     448047 physics events (1838.93 Hz), 4854147 moni events, 862502 SN events, 83936 tcals
Then we swapped the DSB board an restarted normal operations. 
DAQRun [2009-11-02 22:56:28.344772] Version info: DAQRun.py 4161 2009-05-19 01:41:26Z dglo Delfina 2644:4661
DAQRun [2009-11-02 22:56:28.344999] Starting run 114745...
DAQRun [2009-11-02 22:56:28.345117] Run configuration: sps-IC59-Discworld-and-Corporal-Whitcomb-tweaks-V104
DAQRun [2009-11-02 22:56:28.345234] Cluster configuration: ic59-it8-tb2-no-amanda.xml
DAQRun [2009-11-02 22:57:34.278152] Started run 114745 on run set 1
DAQRun [2009-11-02 22:57:34.976125]     0 physics events (0.00 Hz), 29715 moni events, 874 SN events, 0 tcals
DAQRun [2009-11-02 22:58:34.575081]     109881 physics events (1764.16 Hz), 1214282 moni events, 217414 SN events, 20723 tcals
DAQRun [2009-11-02 22:59:34.589850]     224494 physics events (1835.60 Hz), 1490397 moni events, 435764 SN events, 42007 tcals
DAQRun [2009-11-02 23:00:34.618581]     337867 physics events (1853.07 Hz), 1766501 moni events, 653677 SN events, 63393 tcals
DAQRun [2009-11-02 22:56:28.344772] Version info: DAQRun.py 4161 2009-05-19 01:41:26Z dglo Delfina 2644:4661
DAQRun [2009-11-02 22:56:28.344999] Starting run 114745...
DAQRun [2009-11-02 22:56:28.345117] Run configuration: sps-IC59-Discworld-and-Corporal-Whitcomb-tweaks-V104
DAQRun [2009-11-02 22:56:28.345234] Cluster configuration: ic59-it8-tb2-no-amanda.xml
DAQRun [2009-11-02 22:57:34.278152] Started run 114745 on run set 1
DAQRun [2009-11-02 22:57:34.976125]     0 physics events (0.00 Hz), 29715 moni events, 874 SN events, 0 tcals
DAQRun [2009-11-02 22:58:34.575081]     109881 physics events (1764.16 Hz), 1214282 moni events, 217414 SN events, 20723 tcals
DAQRun [2009-11-02 22:59:34.589850]     224494 physics events (1835.60 Hz), 1490397 moni events, 435764 SN events, 42007 tcals
DAQRun [2009-11-02 23:00:34.618581]     337867 physics events (1853.07 Hz), 1766501 moni events, 653677 SN events, 63393 tcals
First action for the new WOs, with help from Camille and Erik. :-)

Emanuel Jacobi | 02 Nov 2009 17:23 GMT | Ice Cube/Runs | | permalink