Search below for 'logbook_sop' for help on usage.
Sections
- AMANDA - 417
- Computing - 183
- Hardware - 103
- Misc - 2
- Runs - 57
- Supernova - 39
- TWR - 7
- Temperature - 5
- Training - 6
- IceCube - 1932
- AURA - 14
- Commissioning - 81
- DAQ - 15
- DOMs - 66
- Deployment - 12
- HoseReel - 5
- ICL - 179
- IceTop - 114
- Inclinometer - 9
- Infrastructure - 128
- Misc - 220
- PBS - 2
- PNF - 17
- Power - 15
- Runs - 718
- RCAs - 297
- SPATS - 3
- SPOTS - 14
- SPS - 285
- StandardCandle - 2
- Testing - 8
- Training - 5
- MAPO - 124
- Misc - 41
- PowerOutages - 1
- SPADE - 1140
- SPASE - 6
Search
Archives
| November 2009 | ||||||
|---|---|---|---|---|---|---|
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 |
| 8 | 9 | 10 | 11 | 12 | 13 | 14 |
| 15 | 16 | 17 | 18 | 19 | 20 | 21 |
| 22 | 23 | 24 | 25 | 26 | 27 | 28 |
| 29 | 30 | |||||
- November 2009 (61)
- October 2009 (52)
- September 2009 (59)
- August 2009 (57)
- July 2009 (60)
- June 2009 (61)
- May 2009 (66)
- April 2009 (52)
- March 2009 (81)
- February 2009 (30)
- January 2009 (85)
- December 2008 (118)
- November 2008 (136)
- October 2008 (143)
- September 2008 (116)
- August 2008 (219)
- July 2008 (228)
- June 2008 (269)
- May 2008 (236)
- April 2008 (160)
- March 2008 (145)
- February 2008 (141)
- January 2008 (131)
- December 2007 (104)
- November 2007 (103)
- October 2007 (8)
- September 2007 (9)
- August 2007 (19)
- July 2007 (10)
- June 2007 (23)
- May 2007 (15)
- April 2007 (34)
- March 2007 (83)
- February 2007 (17)
- January 2007 (3)
- December 2006 (14)
- November 2006 (42)
- October 2006 (40)
- September 2006 (37)
- August 2006 (30)
- July 2006 (57)
- June 2006 (27)
- May 2006 (40)
- April 2006 (50)
- March 2006 (56)
- February 2006 (38)
- January 2006 (93)
- December 2005 (4)
Jan 30, 2008
sps-ichub53 and sps-ichub54 have DOR card problems
By: TeX Time: 2008030 08:09Z When I got up this afternoon, I ran into alfio after breakfast and he mentioned problems on these two DOM hubs. 08:12Z Mr. Kleist calls and offers to help, I told him probably not necessary but that I would call him later if I needed it. 08:13Z testdaq@sps-ichub53:checkGPS Key: . - External & GPS, all looks good BAD - External & No GPS INT - Internal & GPS DOR - Internal & No GPS dt - delta-t between GPS pulses is wrong, use 'readgps # -d' for further info " " - No DOR card detected *?* - Program Error: type from clksel unkown. #? - Program Error: unexpected dir structure. ----------- Hub: sps-ichub53 crd0 . crd1 . crd2 . crd3 . crd4 . crd5 . crd6 . crd7 BAD ----------- >>> sps-ichub53 : Card 7 pair 0 pwr check: plugged(ERR_UNPLUGGED) >>> current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) >>> voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub53 : Card 7 pair 1 pwr check: plugged(ERR_UNPLUGGED) >>> current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) >>> voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub53 : Card 7 pair 2 pwr check: plugged(ERR_UNPLUGGED) >>> current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) >>> voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub53 : Card 7 pair 3 pwr check: plugged(ERR_UNPLUGGED) >>> current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) >>> voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub53 : Unexpected # of Quads plugged in: expected 13; found 14. %fvers.pl Driver V02-11-05 (dh.c : 1.381 $) /proc/driver/domhub/card0 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card1 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card2 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card3 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card4 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card5 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card6 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card7 -- Corrupt FREV: FREV 0xffffffff Looks like a card7 problem. 08:14Z On sps-ichub54: %checkGPS Hub: sps-ichub54 crd0 . crd1 . crd2 BAD crd3 BAD crd4 BAD crd5 BAD crd6 BAD crd7 BAD ----------- >>> sps-ichub54 : Card 2 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 2 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 2 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 2 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 3 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 3 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 3 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 3 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 4 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 4 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 4 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 4 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 5 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 5 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 5 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 5 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 6 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 6 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 6 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 6 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 7 pair 0 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 7 pair 1 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 7 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Card 7 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ERR_CURRENT_ABOVE_LIMITS) voltage(ERR_VOLTAGE_BELOW_LIMITS,ERR_VOLTAGE_ABOVE_LIMITS) >>> sps-ichub54 : Unexpected # of Quads plugged in: expected 13; found 16. %fvers.pl Driver V02-11-05 (dh.c : 1.381 $) /proc/driver/domhub/card0 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card1 -- PCI=9, FW=104q, DOR=1 /proc/driver/domhub/card2 -- Corrupt FREV: FREV 0xffffffff . /proc/driver/domhub/card3 -- Corrupt FREV: FREV 0xffffffff . /proc/driver/domhub/card4 -- Corrupt FREV: FREV 0xffffffff . /proc/driver/domhub/card5 -- Corrupt FREV: FREV 0xffffffff . /proc/driver/domhub/card6 -- Corrupt FREV: FREV 0xffffffff . /proc/driver/domhub/card7 -- Corrupt FREV: FREV 0xffffffff So more problems here - cards 2-7. Jacobsen calls from B2, wants me to stop while he looks at the issue. 08:29Z Jacobsen calls back, says a reboot fixed the issues. Says this behaviour is rare, but has happened a few times.
Edgar Nielsen
|
30 Jan 2008 02:30 GMT
|
Ice Cube/Commissioning
|
|
