Sent mail to run coordination list. 08:07Z testdaq@sps-ichub29 status commands shows: SPS-ICHUB29 SUMMARY: DOR Port Qud DORserial# Stat Pos NAME MBID DOMID RawC CorrC Volts State 00B 5001 Q_2 R1B0802D05 COMM 29-01 Demophobia 753429b1f63d UP5P0668 88 mA 88 mA 89V busy 00A 5002 Q_2 R1B0802D05 COMM 29-02 Ostraconophobia 547cf31ff4c8 TP5P0639 88 mA 88 mA 89V busy 01B 5003 Q_2 R1B0802D05 COMM 29-03 Geniophobia c992e597a438 UP5P0726 87 mA 87 mA 89V busy 01A 5004 Q_2 R1B0802D05 COMM 29-04 Panophobia 6e41ab3703aa TP5P0655 87 mA 87 mA 89V busy 02B 5005 Q_3 R1B0802D05 COMM 29-05 Ephebiphobia 81f0a16ec914 UP5P0618 88 mA 87 mA 89V busy 02A 5006 Q_3 R1B0802D05 COMM 29-06 Thalassophobia 173206b4f36c TP5P0719 88 mA 87 mA 89V busy 03B 5007 Q_3 R1B0802D05 COMM 29-07 Koinoniphobia e3eee807094f UP5P0694 90 mA 89 mA 89V busy 03A 5008 Q_3 R1B0802D05 COMM 29-08 Ostbahnhof 9ef3fedb9d36 TP5Y0089 89 mA 88 mA 89V busy 10B 5009 Q_4 R1B0803D05 COMM 29-09 Acerophobia 12d19e75bc5a UP5P0740 87 mA 88 mA 89V busy 10A 5010 Q_4 R1B0803D05 COMM 29-10 Microphilia f4610aed678c TP5P0839 87 mA 88 mA 89V busy 11B 5011 Q_4 R1B0803D05 COMM 29-11 Farsta 3740f1e662c4 UP5H0110 88 mA 86 mA 89V busy 11A 5012 Q_4 R1B0803D05 COMM 29-12 Olfactophobia f765a906660e TP5P0671 88 mA 86 mA 89V busy 20B 5017 Q_6 R1B0804D05 COMM 29-17 Lampwick b897262bf58a UP5P0580 85 mA 86 mA 89V busy 20A 5018 Q_6 R1B0804D05 COMM 29-18 Yurei 7b25f215b425 TP5P0601 85 mA 86 mA 89V busy 21B 5019 Q_6 R1B0804D05 COMM 29-19 Dodge_Viper 8f96faaca054 UP5Y0074 85 mA 86 mA 89V busy 21A 5020 Q_6 R1B0804D05 COMM 29-20 Vitore f49ee981a008 TP5P0577 85 mA 86 mA 89V busy 22B 5021 Q_7 R1B0804D05 COMM 29-21 Kobold 396a5d961de1 UP5P0612 88 mA 85 mA 89V busy 22A 5022 Q_7 R1B0804D05 COMM 29-22 Siderophobia 6368b5d0bb78 TP5P0691 88 mA 85 mA 89V busy 23B 5023 Q_7 R1B0804D05 COMM 29-23 Hedonophobia fc11ec76b61c UP5P0716 85 mA 89 mA 89V busy 23A 5024 Q_7 R1B0804D05 COMM 29-24 Yeti 3513aaef1b5b TP5P0613 85 mA 89 mA 89V busy 30B 5025 Q_8 R1B0805D05 COMM 29-25 Ideophobia 0f8b70fee5bd UP5P0708 86 mA 85 mA 89V busy 30A 5026 Q_8 R1B0805D05 COMM 29-26 Tensta b5e30e459da4 TP5H0157 87 mA 86 mA 89V busy 31B 5027 Q_8 R1B0805D05 COMM 29-27 Amychophobia 6b22691c7809 UP5P0614 91 mA 88 mA 88V busy 31A 5028 Q_8 R1B0805D05 COMM 29-28 Zemmiphobia a59c9e8c40b6 TP5P0633 91 mA 88 mA 88V busy 32B 5029 Q_9 R1B0805D05 COMM 29-29 Hobophobia 76716b1074c1 UP5P0648 87 mA 87 mA 89V busy 32A 5030 Q_9 R1B0805D05 COMM 29-30 Tetanophobia 426393f54b3c TP5P0637 87 mA 87 mA 89V busy 33B 5031 Q_9 R1B0805D05 COMM 29-31 Bigfoot 1551e2c72d57 UP5P0550 78 mA 86 mA 89V busy 33A 5032 Q_9 R1B0805D05 COMM 29-32 Grunau 345439194e49 TP5Y0073 78 mA 86 mA 89V busy 40B 5033 Q10 R1B0806D05 COMM 29-33 Coitophobia 80bf89d1a264 UP5P0698 89 mA 89 mA 89V busy 40A 5034 Q10 R1B0806D05 COMM 29-34 Telephonophobia b352db1a3e9a TP5P0723 89 mA 89 mA 89V busy 41B 5035 Q10 R1B0806D05 COMM 29-35 Equinophobia c7f5e1b27dd2 UP5P0628 86 mA 89 mA 89V busy 41A 5036 Q10 R1B0806D05 COMM 29-36 Politicophobia 134cbe8a1688 TP5P0675 86 mA 89 mA 89V busy 42B 5037 Q11 R1B0806D05 COMM 29-37 Heliophobia ffa332fbf3a4 UP5P0684 88 mA 88 mA 89V busy 42A 5038 Q11 R1B0806D05 COMM 29-38 Akalla 7dd7dbc1e5aa TP5H0165 88 mA 88 mA 89V busy 43B 5039 Q11 R1B0806D05 COMM 29-39 Heterophobia 45f49f30d235 UP5P0742 89 mA 90 mA 89V busy 43A 5040 Q11 R1B0806D05 COMM 29-40 Novercaphobia f64cd2807fc9 TP5P0725 89 mA 90 mA 89V busy 50B 5041 Q12 R1B0807D05 COMM 29-41 Elfin_Clubman 6b2910ec59bc UP5Y0082 89 mA 88 mA 88V busy 50A 5042 Q12 R1B0807D05 COMM 29-42 Symmetrophobia 979a9d734707 TP5P0679 89 mA 88 mA 88V busy 51B 5043 Q12 R1B0807D05 COMM 29-43 Gargoyle 1b699147c996 UP5P0514 88 mA 89 mA 89V busy 51A 5044 Q12 R1B0807D05 COMM 29-44 Waterspout 320455e571e3 TP5P0513 88 mA 89 mA 89V busy 52B 5045 Q13 R1B0807D05 COMM 29-45 Cape_Doctor b35b5ab19233 UP5P0512 88 mA 89 mA 89V busy 52A 5046 Q13 R1B0807D05 COMM 29-46 Trade_Wind b5f7530e95da TP5P0539 88 mA 89 mA 89V busy 53B 5047 Q13 R1B0807D05 COMM 29-47 Foehn 686822b226b8 UP5P0530 90 mA 89 mA 89V busy 53A 5048 Q13 R1B0807D05 COMM 29-48 Myrmecophilia 838365d96c9c TP5P0875 90 mA 89 mA 89V busy 60B 5049 Q14 R1B0808D05 COMM 29-49 Cyclone 454611892eea UP5P0534 89 mA 90 mA 89V busy 60A 5050 Q14 R1B0808D05 COMM 29-50 Peladophobia 20cc089e04a8 TP5P0645 88 mA 89 mA 89V busy 61B 5051 Q14 R1B0808D05 COMM 29-51 Abrahamsberg 10dbd5f897a7 UP5H0166 88 mA 90 mA 89V busy 61A 5052 Q14 R1B0808D05 COMM 29-52 Phengophobia 3c2770177988 TP5P0623 88 mA 90 mA 89V busy 62B 5053 Q15 R1B0808D05 COMM 29-53 Land_Rover f2c126e81f64 UP5Y0124 91 mA 91 mA 89V busy 62A 5054 Q15 R1B0808D05 COMM 29-54 Nomatophobia fe6b36e170cc TP5P0647 91 mA 91 mA 89V busy 63B 5055 Q15 R1B0808D05 COMM 29-55 Itchetiky ec54677bbb9e UP5P0582 89 mA 90 mA 89V busy 63A 5056 Q15 R1B0808D05 COMM 29-56 Mnemophobia 298d81d7e130 TP5P0603 89 mA 90 mA 89V busy 70B 5057 Q16 R1B0809D05 COMM 29-57 Odenplan b3732fdb626b UP5H0168 91 mA 89 mA 89V busy 70A 5058 Q16 R1B0809D05 COMM 29-58 Nikolassee be5843e76a69 TP5Y0111 91 mA 89 mA 89V busy communicating 54 DOMs; busy 54 DOMs; >>> sps-ichub29 : Card 1 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ok) voltage(ok,ok) >>> sps-ichub29 : Card 1 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ok,ok) voltage(ok,ok) >>> sps-ichub29 : Unexpected # of communicating DOMs: expected 58; found 54. >>> sps-ichub29 : Unexpected # of Quads plugged in: expected 15; found 14. 08:10Z pDown, then pUp returns: Powering up < ALL > DOMs on hub: sps-ichub29 ... Found 54 communicating DOMs. Turned on < ALL > (56) DOMs. - - - - - Moving < ALL > (54) DOMs into iceboot... [ Moved 54 DOMs into iceboot build version 431 ] Moved a total of 54 DOMs into iceboot. There are 53 DOMs in iceboot. >>> sps-ichub29 : Card 1 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ok) voltage(ok,ok) >>> sps-ichub29 : Card 1 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ok,ok) voltage(ok,ok) >>> sps-ichub29 : Unexpected # of communicating DOMs: expected 58; found 54. >>> sps-ichub29 : Unexpected # of Quads plugged in: expected 15; found 14. * * * * * * Full Power Up Report; SPS-ICHUB29 DOMs turned on : 56 Communicating DOMs : 54 DOMs moved into iceboot : 54 Total DOMs in iceboot : 53 DOMs NOT in iceboot : 3 Communicating DOMs NOT in iceboot : 1 Expected # of DOMs in iceboot : 58 Powered up < ALL > DOMs. >>> sps-ichub29 : Unexpected # of DOMs in IceBoot: expected 58; found: 53 >>> sps-ichub29 : Card 1 pair 2 pwr check: plugged(ERR_UNPLUGGED) current(ERR_CURRENT_BELOW_LIMITS,ok) voltage(ok,ok) >>> sps-ichub29 : Card 1 pair 3 pwr check: plugged(ERR_UNPLUGGED) current(ok,ok) voltage(ok,ok) >>> sps-ichub29 : Unexpected # of communicating DOMs: expected 58; found 54. >>> sps-ichub29 : Unexpected # of Quads plugged in: expected 15; found 14. So problem not fixed. Me or erd need to go to ICL to check it out. 09:01Z Got to the ICL. Just did testdaq@sps-ichub29:pDown before checking cables. (Turning off DOM power as well). 09:08Z Yep, card 1's bottom cable was completely fallen out. I checked all the other cables and over a third of the screws were not tightened at all. This means we should check all other hubs for this problem. pUp now returns: Found 58 communicating DOMs. Turned on < ALL > (60) DOMs. - - - - - Moving < ALL > (58) DOMs into iceboot... [ Moved 58 DOMs into iceboot build version 431 ] Moved a total of 58 DOMs into iceboot. There are 56 DOMs in iceboot. >>> sps-ichub29 : Card 1 pair 2 pwr check: plugged(ERR_UNPLUGGED) >>> current(ok,ok) voltage(ok,ok) >>> sps-ichub29 : Card 1 pair 3 pwr check: plugged(ERR_UNPLUGGED) >>> current(ok,ok) voltage(ok,ok) * * * * * * Full Power Up Report; SPS-ICHUB29 DOMs turned on : 60 Communicating DOMs : 58 DOMs moved into iceboot : 58 Total DOMs in iceboot : 56 DOMs NOT in iceboot : 4 Communicating DOMs NOT in iceboot : 2 Expected # of DOMs in iceboot : 58 Powered up < ALL > DOMs. >>> sps-ichub29 : Unexpected # of DOMs in IceBoot: expected 58; found: 56 >>> sps-ichub29 : Card 1 pair 2 pwr check: plugged(ERR_UNPLUGGED) >>> current(ok,ok) voltage(ok,ok) >>> sps-ichub29 : Card 1 pair 3 pwr check: plugged(ERR_UNPLUGGED) >>> current(ok,ok) voltage(ok,ok) Status has these additional lines now: 12B 5013 Q_5 R1B0803D05 COMM 29-13 Rinkeby 1375759346b9 UP5H0112 78 mA 76 mA 89V iceboot 12A 5014 Q_5 R1B0803D05 COMM 29-14 Metrophobia 14be85ac9369 TP5P0697 79 mA 77 mA 89V iceboot 13B 5015 Q_5 R1B0803D05 COMM 29-15 Ecclesiophobia a4bdff4f7bd0 UP5P0664 76 mA 78 mA 89V iceboot 13A 5016 Q_5 R1B0803D05 COMM 29-16 Sluag e003d4bb5d53 TP5P0607 76 mA 78 mA 89V iceboot 09:11Z I'm assuming I need to clear the ERR_UNPLUGGED, like I did on sps-ithub01 a week or so ago. 0. testdaq@sps-ichub29:pDown 1. sudo /etc/init.d/dhrc restart #as a user w/ sudo priv's 2. testdaq@sps-ichub29:pUp # this powers up and puts DOMs into iceboot Hmm, the pUp returns: Found 58 communicating DOMs. Turned on < ALL > (60) DOMs. - - - - - Moving < ALL > (58) DOMs into iceboot... [ Moved 58 DOMs into iceboot build version 431 ] Moved a total of 58 DOMs into iceboot. There are 57 DOMs in iceboot. * * * * * * Full Power Up Report; SPS-ICHUB29 DOMs turned on : 60 Communicating DOMs : 58 DOMs moved into iceboot : 58 Total DOMs in iceboot : 57 DOMs NOT in iceboot : 3 Communicating DOMs NOT in iceboot : 1 Expected # of DOMs in iceboot : 58 Powered up < ALL > DOMs. But by the time I ran 'status' as testdaq, all DOMs in iceboot: communicating 58 DOMs; iceboot 58 DOMs; 09:19Z So starting up the run again on pdaq@sps-expcont:anvil start sam anvil start -j I3DAQOnly -p PhysicsFiltering -v -d sps-I3-only-lc2-nopedsub-use-IceTop-MPE-V019 -r PhysicsTrig -n 40000 -l 28800 sam 2007-12-12 09:18:55: Started 'sam' service with PID=1749 2007-12-12 09:18:55: Parameters for this run set: 2007-12-12 09:18:55: Run Mode: PhysicsTrig 2007-12-12 09:18:55: DAQ Label: sps-I3-only-lc2-nopedsub-use-IceTop-MPE-V019 2007-12-12 09:18:55: JeB Label: I3DAQOnly (2) 2007-12-12 09:18:55: PnF Label: PhysicsFiltering (1) 2007-12-12 09:18:55: Run Length: 28800 2007-12-12 09:18:55: Number of Runs: 40000 2007-12-12 09:18:55: Started 'run' service 2007-12-12 09:18:55: Parameters for this run: 2007-12-12 09:18:55: Run Number: 109842 2007-12-12 09:18:55: Run Mode: PhysicsTrig 2007-12-12 09:18:55: DAQ Label: sps-I3-only-lc2-nopedsub-use-IceTop-MPE-V019 2007-12-12 09:18:55: JeB Label: I3DAQOnly (2) 2007-12-12 09:18:55: PnF Label: PhysicsFiltering (1) 2007-12-12 09:18:55: Starting run 109842 2007-12-12 09:18:57: Starting 'daq' sub-system 2007-12-12 09:19:45: Started run 109842 09:25Z Emailed run coordination list.

Edgar Nielsen | 12 Dec 2007 03:25 GMT | Ice Cube/Runs | |