Search below for 'logbook_sop' for help on usage.
Sections
- AMANDA - 417
- Computing - 183
- Hardware - 103
- Misc - 2
- Runs - 57
- Supernova - 39
- TWR - 7
- Temperature - 5
- Training - 6
- IceCube - 1922
- AURA - 14
- Commissioning - 81
- DAQ - 15
- DOMs - 66
- Deployment - 12
- HoseReel - 5
- ICL - 179
- IceTop - 114
- Inclinometer - 9
- Infrastructure - 127
- Misc - 220
- PBS - 2
- PNF - 17
- Power - 15
- Runs - 710
- RCAs - 297
- SPATS - 3
- SPOTS - 14
- SPS - 284
- StandardCandle - 2
- Testing - 8
- Training - 5
- MAPO - 124
- Misc - 41
- PowerOutages - 1
- SPADE - 1104
- SPASE - 6
Search
Archives
| November 2009 | ||||||
|---|---|---|---|---|---|---|
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
| 1 | 2 | 3 | 4 | 5 | 6 | 7 |
| 8 | 9 | 10 | 11 | 12 | 13 | 14 |
| 15 | 16 | 17 | 18 | 19 | 20 | 21 |
| 22 | 23 | 24 | 25 | 26 | 27 | 28 |
| 29 | 30 | |||||
- November 2009 (15)
- October 2009 (52)
- September 2009 (59)
- August 2009 (57)
- July 2009 (60)
- June 2009 (61)
- May 2009 (66)
- April 2009 (52)
- March 2009 (81)
- February 2009 (30)
- January 2009 (85)
- December 2008 (118)
- November 2008 (136)
- October 2008 (143)
- September 2008 (116)
- August 2008 (219)
- July 2008 (228)
- June 2008 (269)
- May 2008 (236)
- April 2008 (160)
- March 2008 (145)
- February 2008 (141)
- January 2008 (131)
- December 2007 (104)
- November 2007 (103)
- October 2007 (8)
- September 2007 (9)
- August 2007 (19)
- July 2007 (10)
- June 2007 (23)
- May 2007 (15)
- April 2007 (34)
- March 2007 (83)
- February 2007 (17)
- January 2007 (3)
- December 2006 (14)
- November 2006 (42)
- October 2006 (40)
- September 2006 (37)
- August 2006 (30)
- July 2006 (57)
- June 2006 (27)
- May 2006 (40)
- April 2006 (50)
- March 2006 (56)
- February 2006 (38)
- January 2006 (93)
- December 2005 (4)
Oct 31, 2008
SPADE tape tape_2008_522_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
31 Oct 2008 20:44 GMT
|
SPADE
|
|
Stopped run 111884 to fixed dropped DOM 68-01 "Abborre"
Ethan Dicks
|
31 Oct 2008 10:48 GMT
|
Ice Cube/Runs
|
|
Attempts to restart detector in full configuration unsuccessful
Ethan Dicks
|
31 Oct 2008 10:36 GMT
|
Ice Cube/Runs
|
|
Replacing TWR Crate 1/Module 7
Ethan Dicks
|
31 Oct 2008 10:17 GMT
|
AMANDA/Hardware
|
|
Replaced disk drive in ic-twrdaq00
Ethan Dicks
|
31 Oct 2008 09:18 GMT
|
AMANDA/Hardware
|
|
Rebuilt sps-supercore from backup
Ethan Dicks
|
31 Oct 2008 07:24 GMT
|
Ice Cube/SPS
|
|
Replaced disk drive in sps-supercore
Ethan Dicks
|
31 Oct 2008 07:06 GMT
|
Ice Cube/SPS
|
|
ic-tape2:/dev/nst3 new tape
Edgar Nielsen
|
31 Oct 2008 06:31 GMT
|
SPADE
|
|
Power cycling ic-tape2 tape drives
Edgar Nielsen
|
31 Oct 2008 06:30 GMT
|
SPADE
|
|
Fixed error state of anvil
Edgar Nielsen
|
31 Oct 2008 05:14 GMT
|
Ice Cube/Runs
|
|
sps-sattx array corruption again.
Edgar Nielsen
|
31 Oct 2008 04:48 GMT
|
SPADE
|
|
Oct 30, 2008
SPADE tape tape_2008_521_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
30 Oct 2008 15:45 GMT
|
SPADE
|
|
Oct 29, 2008
Array failure on sps-sattx
Edgar Nielsen
|
29 Oct 2008 16:56 GMT
|
Ice Cube/SPS
|
|
Replaced disk drive in sps-supercore
Ethan Dicks
|
29 Oct 2008 16:22 GMT
|
Ice Cube/SPS
|
|
Brought mop water to the ICL
Edgar Nielsen
|
29 Oct 2008 01:28 GMT
|
Ice Cube/ICL
|
|
Oct 27, 2008
sps-ups13 has 0% capacity!
Edgar Nielsen
|
27 Oct 2008 21:41 GMT
|
Ice Cube/Infrastructure
|
|
Inclinomite!
Edgar Nielsen
|
27 Oct 2008 21:21 GMT
|
Ice Cube/Inclinometer
|
|
Physical DNF checks and Hose Reel readings
Edgar Nielsen
|
27 Oct 2008 20:54 GMT
|
Ice Cube/Misc
|
|
Oct 26, 2008
New work
Edgar Nielsen
|
26 Oct 2008 15:45 GMT
|
Ice Cube/Testing
|
|
RCA for run 111850: unknown
Edgar Nielsen
|
26 Oct 2008 04:01 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111851: unknown
Edgar Nielsen
|
26 Oct 2008 04:01 GMT
|
Ice Cube/Runs/RCAs
|
|
Oct 25, 2008
Status
Edgar Nielsen
|
25 Oct 2008 23:06 GMT
|
Ice Cube/Testing
|
|
SPOTS shutdown
Edgar Nielsen
|
25 Oct 2008 22:23 GMT
|
Ice Cube/SPOTS
|
|
daily checks
Edgar Nielsen
|
25 Oct 2008 20:26 GMT
|
Ice Cube/ICL
|
|
Daily checks
Edgar Nielsen
|
25 Oct 2008 20:26 GMT
|
MAPO
|
|
DNF checks
Edgar Nielsen
|
25 Oct 2008 17:19 GMT
|
Ice Cube/Misc
|
|
sps-sattx array issues
Edgar Nielsen
|
25 Oct 2008 15:36 GMT
|
Ice Cube/SPS
|
|
Oct 24, 2008
restarting SPADE
Edgar Nielsen
|
24 Oct 2008 23:57 GMT
|
SPADE
|
|
Daily checks
Edgar Nielsen
|
24 Oct 2008 22:03 GMT
|
MAPO
|
|
Pulled back everything.
Edgar Nielsen
|
24 Oct 2008 21:34 GMT
|
Ice Cube/Testing
|
|
Daily checks
Edgar Nielsen
|
24 Oct 2008 17:14 GMT
|
Ice Cube/ICL
|
|
sps-fpmaster disk errors
Edgar Nielsen
|
24 Oct 2008 13:21 GMT
|
Ice Cube/SPS
|
|
DOM testing at the ICL
Edgar Nielsen
|
24 Oct 2008 09:42 GMT
|
Ice Cube/Testing
|
|
sps-dbs disk errors
Edgar Nielsen
|
24 Oct 2008 08:25 GMT
|
Ice Cube/SPS
|
|
sps-build64 disk errors
Edgar Nielsen
|
24 Oct 2008 08:11 GMT
|
Ice Cube/SPS
|
|
Replacing TWR Crate 3, TWR card A
Edgar Nielsen
|
24 Oct 2008 05:13 GMT
|
AMANDA/Hardware
|
|
Visual DNF checks
Edgar Nielsen
|
24 Oct 2008 03:10 GMT
|
Ice Cube/Misc
|
|
Daily checks
Edgar Nielsen
|
24 Oct 2008 03:09 GMT
|
MAPO
|
|
Oct 23, 2008
Daily checks
Edgar Nielsen
|
23 Oct 2008 15:43 GMT
|
MAPO
|
|
Visual DNF checks
Edgar Nielsen
|
23 Oct 2008 15:43 GMT
|
Ice Cube/Misc
|
|
RCA for run 111842: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111841: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111840: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111839: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111838: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111837: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111836: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111834: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111833: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111832: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111830: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111825: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111824: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 1000375: testing/SLC
Edgar Nielsen
|
23 Oct 2008 15:30 GMT
|
Ice Cube/Runs/RCAs
|
|
Dropped DOM on sps-ichub73 - 11A
Edgar Nielsen
|
23 Oct 2008 13:51 GMT
|
Ice Cube/DOMs
|
|
RCA for run 111810: flasher_runs
Edgar Nielsen
|
23 Oct 2008 06:40 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111808: flasher_runs
Edgar Nielsen
|
23 Oct 2008 06:40 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111807: flasher_runs
Edgar Nielsen
|
23 Oct 2008 06:40 GMT
|
Ice Cube/Runs/RCAs
|
|
Oct 22, 2008
Found the sun shades
Edgar Nielsen
|
22 Oct 2008 22:53 GMT
|
Ice Cube/Testing
|
|
status report
Edgar Nielsen
|
22 Oct 2008 22:51 GMT
|
Ice Cube/Infrastructure
|
|
Daily checks
Edgar Nielsen
|
22 Oct 2008 20:29 GMT
|
Ice Cube/ICL
|
|
DOM testing at the ICL status
Edgar Nielsen
|
22 Oct 2008 16:58 GMT
|
Ice Cube/Testing
|
|
ITS watchdog failures
Edgar Nielsen
|
22 Oct 2008 14:54 GMT
|
Ice Cube/Infrastructure
|
|
RCA for run 111802: Darrell_Hamilton:ClosedByInterrupt/Eric_Coplin:ClosedByInterrupt
Edgar Nielsen
|
22 Oct 2008 01:01 GMT
|
Ice Cube/Runs/RCAs
|
|
Oct 21, 2008
After testdaq run by MK, going to normal operations
Edgar Nielsen
|
21 Oct 2008 20:30 GMT
|
Ice Cube/Runs
|
|
Visual DNF checks
Edgar Nielsen
|
21 Oct 2008 20:13 GMT
|
Ice Cube/Misc
|
|
Daily checks
Edgar Nielsen
|
21 Oct 2008 20:12 GMT
|
Ice Cube/ICL
|
|
Daily checks
Edgar Nielsen
|
21 Oct 2008 20:10 GMT
|
MAPO
|
|
Oct 20, 2008
Daily checks
Edgar Nielsen
|
20 Oct 2008 18:12 GMT
|
MAPO
|
|
ntp-master problems
Edgar Nielsen
|
20 Oct 2008 18:10 GMT
|
Ice Cube/Infrastructure
|
|
Daily checks
Edgar Nielsen
|
20 Oct 2008 17:02 GMT
|
Ice Cube/ICL
|
|
Visual DNF checks
Edgar Nielsen
|
20 Oct 2008 15:46 GMT
|
Ice Cube/Misc
|
|
Oct 18, 2008
Restarting normal runs with run 111792
Ethan Dicks
|
18 Oct 2008 22:37 GMT
|
Ice Cube/Runs
|
|
RCA for run 111789: Backdraft:dropped_dom/Plutophobia:dropped_dom
Edgar Nielsen
|
18 Oct 2008 16:04 GMT
|
Ice Cube/Runs/RCAs
|
|
Dropped DOMs on sps-ichub38: Backdraft and Plutophobia
Edgar Nielsen
|
18 Oct 2008 15:55 GMT
|
Ice Cube/DOMs
|
|
Oct 17, 2008
zenoss kickstarted
Ethan Dicks
|
17 Oct 2008 13:47 GMT
|
Ice Cube/SPS
|
|
Installed two 300GB drives in zenoss
Ethan Dicks
|
17 Oct 2008 13:11 GMT
|
Ice Cube/SPS
|
|
Oct 15, 2008
SPADE tape tape_2008_519_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
15 Oct 2008 02:21 GMT
|
SPADE
|
|
Oct 14, 2008
ic-tape2:/dev/nst0 tape change
Edgar Nielsen
|
14 Oct 2008 19:34 GMT
|
SPADE
|
|
sps-sattx /mnt/data2 disk array errors
Edgar Nielsen
|
14 Oct 2008 17:01 GMT
|
SPADE
|
|
ic-tape2:/dev/nst3 tape change
Edgar Nielsen
|
14 Oct 2008 15:35 GMT
|
SPADE
|
|
SPADE tape tape_2008_515_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
14 Oct 2008 06:11 GMT
|
SPADE
|
|
SPADE tape tape_2008_516_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
14 Oct 2008 04:58 GMT
|
SPADE
|
|
Oct 13, 2008
Physical DNF checks and HR
Edgar Nielsen
|
13 Oct 2008 22:17 GMT
|
Ice Cube/Misc
|
|
Powercycled the SNEWS Iridium modem in the ICL
Ethan Dicks
|
13 Oct 2008 22:07 GMT
|
Ice Cube/SPS
|
|
SPADE tape tape_2008_513_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
13 Oct 2008 22:03 GMT
|
SPADE
|
|
SPADE tape tape_2008_511_RAW_copy_1 full. Inserted new tape.
Ethan Dicks
|
13 Oct 2008 22:01 GMT
|
SPADE
|
|
SPADE tape tape_2008_500_FILTERED_copy_1 full. Inserted new tape.
Ethan Dicks
|
13 Oct 2008 22:00 GMT
|
SPADE
|
|
SPADE tape tape_2008_5xx_FILTERED_copy_1 full. Inserted new tape.
Ethan Dicks
|
13 Oct 2008 17:04 GMT
|
SPADE
|
|
Replaced disk drive in sps-sattx2
Ethan Dicks
|
13 Oct 2008 15:47 GMT
|
Ice Cube/SPS
|
|
Oct 12, 2008
Snow Work
Edgar Nielsen
|
12 Oct 2008 16:49 GMT
|
Ice Cube/ICL
|
|
Daily MAPO check not done on Sunday
Edgar Nielsen
|
12 Oct 2008 15:26 GMT
|
MAPO
|
|
Daily ICL check not done on sunday
Edgar Nielsen
|
12 Oct 2008 15:25 GMT
|
Ice Cube/ICL
|
|
heartbeat failures
Edgar Nielsen
|
12 Oct 2008 14:38 GMT
|
Ice Cube/Infrastructure
|
|
Oct 11, 2008
Visual DNF checks
Edgar Nielsen
|
11 Oct 2008 17:44 GMT
|
Ice Cube/Misc
|
|
ITS heartbeat errors again
Edgar Nielsen
|
11 Oct 2008 17:42 GMT
|
Ice Cube/Infrastructure
|
|
NTP alarms
Edgar Nielsen
|
11 Oct 2008 06:47 GMT
|
Ice Cube/Infrastructure
|
|
Oct 10, 2008
RCA for run 111760: xmlrpc-timeout_DAQMoni.py
Edgar Nielsen
|
10 Oct 2008 22:07 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111759: Flatkobben:ClosedByInterrupt
Edgar Nielsen
|
10 Oct 2008 22:07 GMT
|
Ice Cube/Runs/RCAs
|
|
RH5.2 on sps-fpslave21
Edgar Nielsen
|
10 Oct 2008 19:08 GMT
|
Ice Cube/SPS
|
|
Daily checks
Edgar Nielsen
|
10 Oct 2008 18:29 GMT
|
MAPO
|
|
Flagline removal mostly done now
Edgar Nielsen
|
10 Oct 2008 18:29 GMT
|
Misc
|
|
Daily checks
Edgar Nielsen
|
10 Oct 2008 18:27 GMT
|
Ice Cube/ICL
|
|
Visual DNF checks
Edgar Nielsen
|
10 Oct 2008 16:44 GMT
|
Ice Cube/Misc
|
|
Oct 09, 2008
More work removing ICL flagline
Edgar Nielsen
|
09 Oct 2008 17:04 GMT
|
Misc
|
|
Daily checks
Edgar Nielsen
|
09 Oct 2008 17:03 GMT
|
MAPO
|
|
Visual DNF checks
Edgar Nielsen
|
09 Oct 2008 17:03 GMT
|
Ice Cube/Misc
|
|
Daily checks
Edgar Nielsen
|
09 Oct 2008 17:02 GMT
|
Ice Cube/ICL
|
|
Oct 08, 2008
Visual DNF checks
Edgar Nielsen
|
08 Oct 2008 21:47 GMT
|
Ice Cube/Misc
|
|
RCA for run 111737: Feta:dropped_dom
Edgar Nielsen
|
08 Oct 2008 16:03 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111736: Pandavas:dropped_dom
Edgar Nielsen
|
08 Oct 2008 16:02 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111739: flasher_runs
Edgar Nielsen
|
08 Oct 2008 06:37 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111740: flasher_runs
Edgar Nielsen
|
08 Oct 2008 06:37 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111745: flasher_runs
Edgar Nielsen
|
08 Oct 2008 06:37 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111741: flasher_runs
Edgar Nielsen
|
08 Oct 2008 06:37 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111742: flasher_runs
Edgar Nielsen
|
08 Oct 2008 06:37 GMT
|
Ice Cube/Runs/RCAs
|
|
RCA for run 111748: eventBuilder.stagnant.NumEventsSent
Edgar Nielsen
|
08 Oct 2008 06:31 GMT
|
Ice Cube/Runs/RCAs
|
|
Oct 07, 2008
ICL flagline removal
Edgar Nielsen
|
07 Oct 2008 23:25 GMT
|
Misc
|
|
Daily checks
Edgar Nielsen
|
07 Oct 2008 23:24 GMT
|
MAPO
|
|
Inclinometer
Edgar Nielsen
|
07 Oct 2008 22:39 GMT
|
Ice Cube/Inclinometer
|
|
Sweep and mop of the ICL 2nd floor
Edgar Nielsen
|
07 Oct 2008 22:38 GMT
|
Ice Cube/ICL
|
|
sps-sattx2 bad memory
Edgar Nielsen
|
07 Oct 2008 22:36 GMT
|
Ice Cube/SPS
|
|
sps-itfreeze bad drive
Edgar Nielsen
|
07 Oct 2008 18:39 GMT
|
Ice Cube/SPS
|
|
Daily checks
Edgar Nielsen
|
07 Oct 2008 17:42 GMT
|
Ice Cube/ICL
|
|
Installing SP3 on sps-itfreeze
Edgar Nielsen
|
07 Oct 2008 16:38 GMT
|
Ice Cube/Ice Top
|
|
Daily visual DNF checks
Edgar Nielsen
|
07 Oct 2008 15:25 GMT
|
Ice Cube/Misc
|
|
Failed drive on sps-fpslave10
Edgar Nielsen
|
07 Oct 2008 00:29 GMT
|
Ice Cube/SPS
|
|
Oct 06, 2008
Daily checks
Edgar Nielsen
|
06 Oct 2008 21:40 GMT
|
MAPO
|
|
sps-sattx2 memory errors
Edgar Nielsen
|
06 Oct 2008 17:09 GMT
|
Ice Cube/SPS
|
|
Daily checks
Edgar Nielsen
|
06 Oct 2008 17:02 GMT
|
Ice Cube/ICL
|
|
Iridium modem needs resetting
Edgar Nielsen
|
06 Oct 2008 14:08 GMT
|
Ice Cube/Infrastructure
|
|
Tape drive 2 needs cleaning
Edgar Nielsen
|
06 Oct 2008 04:45 GMT
|
SPADE
|
|
Visual DNF checks
Edgar Nielsen
|
06 Oct 2008 04:10 GMT
|
Ice Cube/Misc
|
|
Oct 05, 2008
Fixing sps-ithub03:Maniaphobia
Edgar Nielsen
|
05 Oct 2008 23:21 GMT
|
Ice Cube/DOMs
|
|
RCA for run 111730: Maniaphobia:dropped_dom
Edgar Nielsen
|
05 Oct 2008 22:53 GMT
|
Ice Cube/Runs/RCAs
|
|
Drill Camp
Edgar Nielsen
|
05 Oct 2008 19:56 GMT
|
Ice Cube/Misc
|
|
Weekly USAP Safety Inspection
Edgar Nielsen
|
05 Oct 2008 19:52 GMT
|
Ice Cube/ICL
|
|
Daily checks
Edgar Nielsen
|
05 Oct 2008 19:51 GMT
|
MAPO
|
|
Oct 03, 2008
Re-enabled SPADE-to-HSM activity
Ethan Dicks
|
03 Oct 2008 22:45 GMT
|
SPADE
|
|
Disabled SPADE-to-HSM activity to let HSM catch up after problems today
Ethan Dicks
|
03 Oct 2008 22:42 GMT
|
SPADE
|
|
sps-radhub autofs failure
Edgar Nielsen
|
03 Oct 2008 10:52 GMT
|
Ice Cube/SPS
|
|
Undersized SMT fuses replaced on DSB boards
Ethan Dicks
|
03 Oct 2008 08:25 GMT
|
Ice Cube/SPS
|
|
Oct 01, 2008
outer and stockton DNS down again
Edgar Nielsen
|
01 Oct 2008 02:00 GMT
|
Ice Cube/Infrastructure
|
|