Search below for 'logbook_sop' for help on usage.
Sections
- AMANDA - 417
- Computing - 183
- Hardware - 103
- Misc - 2
- Runs - 57
- Supernova - 39
- TWR - 7
- Temperature - 5
- Training - 6
- IceCube - 1922
- AURA - 14
- Commissioning - 81
- DAQ - 15
- DOMs - 66
- Deployment - 12
- HoseReel - 5
- ICL - 179
- IceTop - 114
- Inclinometer - 9
- Infrastructure - 127
- Misc - 220
- PBS - 2
- PNF - 17
- Power - 15
- Runs - 710
- RCAs - 297
- SPATS - 3
- SPOTS - 14
- SPS - 284
- StandardCandle - 2
- Testing - 8
- Training - 5
- MAPO - 124
- Misc - 41
- PowerOutages - 1
- SPADE - 1104
- SPASE - 6
Search
Archives
| November 2009 | ||||||
|---|---|---|---|---|---|---|
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 |
| 8 | 9 | 10 | 11 | 12 | 13 | 14 |
| 15 | 16 | 17 | 18 | 19 | 20 | 21 |
| 22 | 23 | 24 | 25 | 26 | 27 | 28 |
| 29 | 30 | |||||
- November 2009 (15)
- October 2009 (52)
- September 2009 (59)
- August 2009 (57)
- July 2009 (60)
- June 2009 (61)
- May 2009 (66)
- April 2009 (52)
- March 2009 (81)
- February 2009 (30)
- January 2009 (85)
- December 2008 (118)
- November 2008 (136)
- October 2008 (143)
- September 2008 (116)
- August 2008 (219)
- July 2008 (228)
- June 2008 (269)
- May 2008 (236)
- April 2008 (160)
- March 2008 (145)
- February 2008 (141)
- January 2008 (131)
- December 2007 (104)
- November 2007 (103)
- October 2007 (8)
- September 2007 (9)
- August 2007 (19)
- July 2007 (10)
- June 2007 (23)
- May 2007 (15)
- April 2007 (34)
- March 2007 (83)
- February 2007 (17)
- January 2007 (3)
- December 2006 (14)
- November 2006 (42)
- October 2006 (40)
- September 2006 (37)
- August 2006 (30)
- July 2006 (57)
- June 2006 (27)
- May 2006 (40)
- April 2006 (50)
- March 2006 (56)
- February 2006 (38)
- January 2006 (93)
- December 2005 (4)
Mar 30, 2007
Started 30 hours of C and V runs at 02:50UTC on March 31.
Claire Pettersen
|
30 Mar 2007 21:55 GMT
|
Ice Cube/Runs
|
|
Mar 29, 2007
Weekly testdaq runs were started at 23:15UTC March 29 and ended at 01:30UTC March 30. pDAQ was restarted in "icecube-only" mode after the runs finished.
Claire Pettersen
|
29 Mar 2007 20:34 GMT
|
Ice Cube/Runs
|
|
Swapped nst4 and nst6 drives on sps-sattx.
Claire Pettersen
|
29 Mar 2007 18:15 GMT
|
SPADE
|
|
Mar 28, 2007
pDAQ was restarted successfully at ~23:10UTC on March 28 after a power outage in the Dark Sector.
Claire Pettersen
|
28 Mar 2007 18:23 GMT
|
Ice Cube/Runs
|
|
The server gull crashed during the power outage. It was manually rebooted at 23:00 UTC March 28.
Claire Pettersen
|
28 Mar 2007 18:22 GMT
|
Ice Cube/SPS
|
|
ichub56 crashed about 10 minutes after power was restored and pDAQ was running. ichub was manually rebooted at 23:00UTC March 28.
Claire Pettersen
|
28 Mar 2007 18:21 GMT
|
Ice Cube/SPS
|
|
ichub72 was rebooted remotely because it was only showing 53 DOMs communicating. This was at 21:48UTC March 28.
Claire Pettersen
|
28 Mar 2007 18:20 GMT
|
Ice Cube/SPS
|
|
Replaced tape_2007_33_RAW_copy_1 on nst1 with tape_2007_34_RAW_copy_1.
Claire Pettersen
|
28 Mar 2007 18:18 GMT
|
SPADE
|
|
Supernova started after power outage March 28 22.21 UTC
Sven Lidstrom
|
28 Mar 2007 17:44 GMT
|
AMANDA/Supernova
|
|
Mar 27, 2007
Replaced tape in nst1 with new blank tape.
Claire Pettersen
|
27 Mar 2007 17:03 GMT
|
SPADE
|
|
Restarted pDAQ after power outage on icecube-only mode (run no. 106339)
Karthik Soundarapandian
|
27 Mar 2007 00:24 GMT
|
Ice Cube/Runs
|
|
sattx was being worked on between 2200 UTC Mar 26th and 0500 UTC Mar 27th
Karthik Soundarapandian
|
27 Mar 2007 00:22 GMT
|
Ice Cube/SPS
|
|
All the SPS machines were shutdown about 0220 UTC Mar 27th
Karthik Soundarapandian
|
27 Mar 2007 00:17 GMT
|
Ice Cube/SPS
|
|
Power Outage in the ICL between 0130 and 0230 UTC Mar 27th
Karthik Soundarapandian
|
27 Mar 2007 00:14 GMT
|
Ice Cube/ICL
|
|
Supernova was restarted at 04.58 UTC March 27 after power outage
Sven Lidstrom
|
27 Mar 2007 00:14 GMT
|
AMANDA/Supernova
|
|
Mar 26, 2007
TWR DAQ was restarted after the power outage March 27 at 05:12UTC.
Claire Pettersen
|
26 Mar 2007 23:15 GMT
|
AMANDA/TWR
|
|
The pDAQ was restarted after multiple power outages this morning. It started at 22:05UTC on March 26. pDAQ is currently running in icecube-only mode.
Claire Pettersen
|
26 Mar 2007 17:09 GMT
|
Ice Cube/Runs
|
|
ichub57 and fpslave16 restarted at 2150 UTC March 26 after several power outages
Sven Lidstrom
|
26 Mar 2007 17:01 GMT
|
Ice Cube/SPS
|
|
ichub57 crashed during a power outage at the ICL at ~19:00UTC, March 26.
Claire Pettersen
|
26 Mar 2007 15:22 GMT
|
Ice Cube/SPS
|
|
Power outage occurred at ICL at 17:50UTC on March 26.
Claire Pettersen
|
26 Mar 2007 15:06 GMT
|
Ice Cube
|
|
A total power outage occurred at MAPO at 20:00UTC on March 26.
Claire Pettersen
|
26 Mar 2007 15:02 GMT
|
AMANDA
|
|
Mar 24, 2007
Cleaned tapedrive /nst1
Sven Lidstrom
|
24 Mar 2007 13:55 GMT
|
SPADE
|
|
Tape 2007_31_RAW_copy_1 inserted on nst1 at 18.50 UTC March 24
Sven Lidstrom
|
24 Mar 2007 13:53 GMT
|
SPADE
|
|
C&V runs week 12
Sven Lidstrom
|
24 Mar 2007 12:35 GMT
|
Ice Cube/Runs
|
|
Mar 23, 2007
ithub01 was rebooted March 24 at 02.42 UTC
Sven Lidstrom
|
23 Mar 2007 22:29 GMT
|
Ice Cube/SPS
|
|
Weekly Runs week 12
Sven Lidstrom
|
23 Mar 2007 13:30 GMT
|
Ice Cube/Runs
|
|
Mar 22, 2007
TWR DAQ was restarted after 2 station wide power outages March 22.
Sven Lidstrom
|
22 Mar 2007 17:45 GMT
|
AMANDA/TWR
|
|
pDAQ crashed due to power outage at 15:00UTC on March 22. Once all hardware was running, pDAQ was restarted in "icecube-only" mode.
Claire Pettersen
|
22 Mar 2007 15:40 GMT
|
Ice Cube/Runs
|
|
sps-evbuilder crashed due to power outage March 22 at 15:00UTC. It has been rebooted.
Claire Pettersen
|
22 Mar 2007 15:39 GMT
|
Ice Cube/SPS
|
|
ichub46 crashed due to power outage March 22 at 15:00UTC. It has been rebooted.
Claire Pettersen
|
22 Mar 2007 15:38 GMT
|
Ice Cube/SPS
|
|
ichub78 crashed due to power outage on March 22 at 15:00UTC. It has been rebooted.
Claire Pettersen
|
22 Mar 2007 15:37 GMT
|
Ice Cube/SPS
|
|
There was a station-wide power outage for ~5 minutes at 14:50UTC on March 22.
Claire Pettersen
|
22 Mar 2007 10:32 GMT
|
Ice Cube
|
|
Mar 21, 2007
Replaced DOR card 1 on ichub78 due to strange GPS behavior.
Claire Pettersen
|
21 Mar 2007 18:05 GMT
|
Ice Cube/SPS
|
|
pDAQ was stopped at ~21:00UTC and restarted at 23:00UTC March 21.
Claire Pettersen
|
21 Mar 2007 18:03 GMT
|
Ice Cube/Runs
|
|
Tape_2007_30_RAW_copy_1 inserted on nst4
Sven Lidstrom
|
21 Mar 2007 15:01 GMT
|
SPADE
|
|
Tape_2007_29_RAW_copy_1 inserted on nst1
Sven Lidstrom
|
21 Mar 2007 15:00 GMT
|
SPADE
|
|
Mar 20, 2007
DOR card 1 on ichub78 is having a problem with the DSB
Claire Pettersen
|
20 Mar 2007 22:13 GMT
|
Ice Cube/SPS
|
|
Tape_2007_27_RAW_copy_1 inserted on nst5
Sven Lidstrom
|
20 Mar 2007 17:21 GMT
|
SPADE
|
|
Tape 2007_28_RAW_copy_1 inserted on nst2
Sven Lidstrom
|
20 Mar 2007 17:21 GMT
|
SPADE
|
|
Cleaned nst0,nst1,nst3 and nst4 tapedrives 22.20 UTC March 20
Sven Lidstrom
|
20 Mar 2007 17:05 GMT
|
SPADE
|
|
Mar 19, 2007
FCU program had crashed and was restarted 2016 UTC March 19
Sven Lidstrom
|
19 Mar 2007 17:12 GMT
|
Ice Cube/Ice Top
|
|
Mar 18, 2007
SPADE tape_2007_18_FILTERED_copy_1 is full. Inserted tape_2007_26_FILTERED_copy_1 into tape drive 6.
Claire Pettersen
|
18 Mar 2007 23:10 GMT
|
SPADE
|
|
We insulated FCU 72A at approximately 22:00 UTC on March 18th.
Claire Pettersen
|
18 Mar 2007 17:12 GMT
|
Ice Cube/Ice Top
|
|
pDAQ restarted at 1935 UTC Mar 18
Karthik Soundarapandian
|
18 Mar 2007 14:36 GMT
|
Ice Cube/Runs
|
|
Mar 17, 2007
Changed vacuum setting for Tank 72A
Sven Lidstrom
|
17 Mar 2007 16:45 GMT
|
Ice Cube/Ice Top
|
|
pDAQ restarted after C&V runs at 0631 UTC Mar 17 on run 105673
Karthik Soundarapandian
|
17 Mar 2007 01:32 GMT
|
Ice Cube/Runs
|
|
Mar 16, 2007
Turned on the 3rd bulb in tank 72A
Sven Lidstrom
|
16 Mar 2007 22:00 GMT
|
Ice Cube/Ice Top
|
|
Started 7hour C&V Run Mar 16 2108 UTC
Karthik Soundarapandian
|
16 Mar 2007 17:08 GMT
|
Ice Cube/Runs
|
|
pDAQ stopped Mar 16 2200 UTC for C&V Runs
Karthik Soundarapandian
|
16 Mar 2007 16:58 GMT
|
Ice Cube/Runs
|
|
Mar 15, 2007
tape_2007_17_FILTERED_copy_1 full inserted tape_2007_25_FILTERED_copy_1 on nst7
Sven Lidstrom
|
15 Mar 2007 18:18 GMT
|
SPADE
|
|
Mar 14, 2007
Restarted pDAQ after weekly runs about Mar 15 0455 UTC
Karthik Soundarapandian
|
14 Mar 2007 23:55 GMT
|
Ice Cube/Runs
|
|
Testdaq Weekly Runs started about 0316 UTC Mar 15
Karthik Soundarapandian
|
14 Mar 2007 22:19 GMT
|
Ice Cube/Runs
|
|
pDAQ stopped 0300 UTC Mar 15 for weekly testdaq runs
Karthik Soundarapandian
|
14 Mar 2007 21:58 GMT
|
Ice Cube/Runs
|
|
Started pDaq about 2200 UTC Mar 14 on run number 105411
Karthik Soundarapandian
|
14 Mar 2007 17:03 GMT
|
Ice Cube/Runs
|
|
ichub78 rebooted Mar 14 2050 UTC
Karthik Soundarapandian
|
14 Mar 2007 16:46 GMT
|
Ice Cube/SPS
|
|
ichub50 rebooted Mar 14 2030 UTC
Karthik Soundarapandian
|
14 Mar 2007 16:31 GMT
|
Ice Cube/SPS
|
|
hub50 is unreachable
made cluster config ic22-it4-no50 made new run config sps-icecube-amanda-noswt-nostr50 starting run 105298 with this config
Logbook Mirror
|
14 Mar 2007 04:56 GMT
|
Ice Cube/Runs
|
|
Mar 13, 2007
DAQ started aroun 2135 UTC Mar 13
Karthik Soundarapandian
|
13 Mar 2007 16:41 GMT
|
Ice Cube/Runs
|
|
DSB card on ithub01 replaced
Karthik Soundarapandian
|
13 Mar 2007 16:40 GMT
|
Ice Cube/SPS
|
|
Mar 12, 2007
There were 3 hours worth of C and V runs done on March 11 at 02:30 UTC. Normal pDAQ monitoring was resumed following completion of C and V runs.
Claire Pettersen
|
12 Mar 2007 16:39 GMT
|
Ice Cube/Runs
|
|
We took C and V runs for Penn State University. These were started at 10:00 UTC on March 8th and lasted approximately 13 hours. Afterwards, normal pDAQ monitoring resumed.
Claire Pettersen
|
12 Mar 2007 16:35 GMT
|
Ice Cube/Runs
|
|
The Weekly In-Ice and IceTop TestDAQ runs were executed at 01:30 UTC on March 8th. Normal pDAQ resumed after the weekly runs were finsihed.
Claire Pettersen
|
12 Mar 2007 16:26 GMT
|
Ice Cube/Runs
|
|
All 8 drives attached to sattx were cleaned around 2000 UTC Mar 12
Karthik Soundarapandian
|
12 Mar 2007 15:37 GMT
|
Ice Cube/SPS
|
|
Mar 11, 2007
nst5 cleaned and put back in service Mar 11 1800 UTC
Karthik Soundarapandian
|
11 Mar 2007 14:42 GMT
|
SPADE
|
|
sattx rebooted Mar 11 1907 UTC
Karthik Soundarapandian
|
11 Mar 2007 14:40 GMT
|
Ice Cube/SPS
|
|
Mar 10, 2007
Cleaned nst4 on March 10 04.45UTC
Sven Lidstrom
|
10 Mar 2007 21:01 GMT
|
SPADE
|
|
Mar 07, 2007
Rebooted ichub50 around 1900 UTC Mar 7
Karthik Soundarapandian
|
07 Mar 2007 13:41 GMT
|
Ice Cube/SPS
|
|
Restarted pdaq Mar 07 1917 UTC
Karthik Soundarapandian
|
07 Mar 2007 13:38 GMT
|
Ice Cube/Runs
|
|
Mar 05, 2007
Saw this mail and restarted the DAQ in icecube-only mode at run 103075. I found the system in a state where no events were being produced. The cause was the AMANDA mainboard hub: for some reason we have been receiving a very low rate of triggers from AMANDA, viz. 11 Hz or thereabouts. Perhaps that system is still being brought up. I left it outside of the control of anvil - as it was before.
It is important to not use an AMANDA configuration for pDAQ when AMANDA is not running as this will almost surely hose the IceCube DAQ as well. However, when I initially tried to restart the DAQ using the 'sps-icecube-only-001' configuration tag, anvil spat the dummy at me complaining that it didn't know scratch about that configuration. Something has changed - it appears to be the issue that was pointed out in a series of email exchanges between Simon and John on 3/1. I had to hack the daq_cntrl.py script to declare the existence of the aforementioned configuration. This is probably not the best solution - can someone please advise what the right way is? Here is the transcript of the run starts from anvil ... 2007-03-05 14:13:16: Started 'sam' service with PID=14258 2007-03-05 14:13:16: Parameters for this run set: 2007-03-05 14:13:16: Run Mode: Unknown 2007-03-05 14:13:16: DAQ Label: sps-icecube-only-001 (sps-icecube-only-001) 2007-03-05 14:13:16: JeB Label: MergeEvents (1) 2007-03-05 14:13:16: PnF Label: RandomFiltering (2) 2007-03-05 14:13:16: Run Length: 3600 2007-03-05 14:13:16: Number of Runs: 10000 2007-03-05 14:13:16: Started 'run' service 2007-03-05 14:13:16: Parameters for this run: 2007-03-05 14:13:16: Run Number: 103075 2007-03-05 14:13:16: Run Mode: Unknown 2007-03-05 14:13:16: DAQ Label: sps-icecube-only-001 (sps-icecube-only-001) 2007-03-05 14:13:16: JeB Label: MergeEvents (1) 2007-03-05 14:13:16: PnF Label: RandomFiltering (2) 2007-03-05 14:13:16: Starting run 103075 2007-03-05 14:13:16: Starting 'daq' sub-system 2007-03-05 14:13:51: Started run 103075 2007-03-05 14:21:51: Sub-system 'daq' is in 'Error' state, not 'Started' 2007-03-05 14:21:51: Stopping run 103075 2007-03-05 14:21:51: Recovering 'daq' sub-system 2007-03-05 14:22:16: Stopped run 103075 2007-03-05 14:22:16: Stopped 'run' service 2007-03-05 14:22:16: Started 'run' service 2007-03-05 14:22:16: Parameters for this run: 2007-03-05 14:22:16: Run Number: 103076 2007-03-05 14:22:16: Run Mode: Unknown 2007-03-05 14:22:16: DAQ Label: sps-icecube-only-001 (sps-icecube-only-001) 2007-03-05 14:22:16: JeB Label: MergeEvents (1) 2007-03-05 14:22:16: PnF Label: RandomFiltering (2) 2007-03-05 14:22:16: Starting run 103076 2007-03-05 14:22:16: Starting 'daq' sub-system 2007-03-05 14:22:51: Started run 103076
Logbook Mirror
|
05 Mar 2007 08:38 GMT
|
Ice Cube/Runs
|
|
Station lost power about 0545 UTC Mar 05 for 5 minutes
Karthik Soundarapandian
|
05 Mar 2007 03:28 GMT
|
Ice Cube/ICL
|
|
ichub57, ichub78, fpslave08 and fpslave10
Karthik Soundarapandian
|
05 Mar 2007 03:25 GMT
|
Ice Cube/SPS
|
|
nst3 has been cleaned as per Cindy's request.
-karthik
Karthik Soundarapandian
|
05 Mar 2007 03:17 GMT
|
SPADE
|
|
Mar 03, 2007
tape_2007_19_RAW_copy_1_inserted_on_nst1
Sven Lidstrom
|
03 Mar 2007 19:47 GMT
|
SPADE
|
|
tape_2007_22_RAW_copy_1_inserted_on_nst5
Sven Lidstrom
|
03 Mar 2007 19:46 GMT
|
SPADE
|
|
tape_2007_20_RAW_copy_1_inserted_on_nst4
Sven Lidstrom
|
03 Mar 2007 19:45 GMT
|
SPADE
|
|
tape_2007_21_RAW_copy_1_inserted_on_nst2
Sven Lidstrom
|
03 Mar 2007 19:44 GMT
|
SPADE
|
|
Mar 02, 2007
pDAQ restarted
Karthik Soundarapandian
|
02 Mar 2007 22:46 GMT
|
Ice Cube/Runs
|
|
sps-sattx rebooted
Karthik Soundarapandian
|
02 Mar 2007 22:43 GMT
|
Ice Cube/SPS
|
|
Frimware Updated for Tape Drives
Karthik Soundarapandian
|
02 Mar 2007 22:41 GMT
|
Ice Cube/SPS
|
|
Mar 01, 2007
Disk drive 0 on sps-fpslave10
Karthik Soundarapandian
|
01 Mar 2007 13:44 GMT
|
Ice Cube/SPS
|
|
Disk drive 4 on sps-core
Karthik Soundarapandian
|
01 Mar 2007 13:42 GMT
|
Ice Cube/SPS
|
|
Ejected and reinserted the tape in /dev/nst3 as per Cindy's instructions
Karthik Soundarapandian
|
01 Mar 2007 13:39 GMT
|
SPADE
|
|
tape_2007_12_FILTERED_copy_1 full inserted tape_2007_17_FILTERED_copy_1
Karthik Soundarapandian
|
01 Mar 2007 13:38 GMT
|
SPADE
|
|