Home
South Pole Logbook

Search below for 'logbook_sop' for help on usage.

Sections

Search

Archives

November 2009
Sun Mon Tue Wed Thu Fri Sat
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30          

RSS Feed

Powered by Blosxom


Root :: Ice Cube :: DAQ

Dec 09, 2008

Major problem on acquition

There has been a change in the trigger setup (instead of 3 machines, everything is now on one). Since then, runs are failing and communication with the daq system is problematic... We don't have any input from North about what is going on... On sps-extcont as pdaq, we first did an "anvil stop sam" and "anvil lock force". 
pdaq@sps-expcont[~] 05:53:16 (130)$ tailrun

DAQRun [2008-12-09 04:27:00.449121] Run terminated WITH ERROR.
DAQRun [2008-12-09 04:27:00.595915] Queueing data for SPADE (spadeDir=/mnt/data/pdaqlocal, logDir=/mnt/data/pdaq/log, runNum=112122)...
DAQRun [2008-12-09 04:27:00.596500] Target files are:
/mnt/data/pdaqlocal/SPS-pDAQ-run-112122_20081209_042700_003967.dat.tar
/mnt/data/pdaqlocal/SPS-pDAQ-run-112122_20081209_042700_003967.sem
DAQRun [2008-12-09 04:27:01.593943] Link or copy /mnt/data/pdaqlocal/SPS-pDAQ-run-112122_20081209_042700_003967.dat.tar->/mnt/data/pdaq/log-copies/SPS-pDAQ-run-112122_20081209_042700_003967.dat.tar
DAQRun [2008-12-09 04:27:01.596107] Doing complete rip-down and restart of pDAQ (everything but DAQRun)

pdaq@sps-expcont[~] 05:53:16 (130)$ DAQStatus.py
CNC localhost:8080
-----------------------
52 unused components
idle
  amandaTrigger
  eventBuilder
  globalTrigger
  iceTopTrigger
  inIceTrigger
  47 stringHubs: 0 21 29-30 38-40 44-50 52-78 81-86
-----------------------
0 run sets
DAQ state is DAQRun DEAD
Now this command takes too much time: 
pdaq@sps-expcont[~] 05:53:51 (0)$ DAQLaunch.py -k
ssh_exchange_identification: Connection closed by remote host
Crtl-C : 
Traceback (most recent call last):
  File "/usr/local/pdaq/pDAQ_current/dash/DAQLaunch.py", line 359, in ?
    if __name__ == "__main__": main()
  File "/usr/local/pdaq/pDAQ_current/dash/DAQLaunch.py", line 351, in main
    opt.killWith9)
  File "/usr/local/pdaq/pDAQ_current/dash/DAQLaunch.py", line 203, in doKill
    killJavaProcesses(dryRun, clusterConfig, verbose, killWith9)
  File "/usr/local/pdaq/pDAQ_current/dash/DAQLaunch.py", line 129, in killJavaProcesses
    parallel.wait()
  File "/usr/local/pdaq/pDAQ_current/cluster-config/ParallelShell.py", line 184, in wait
    c.wait() # Can raise TimeoutException
  File "/usr/local/pdaq/pDAQ_current/cluster-config/ParallelShell.py", line 113, in wait
    self.subproc.wait()
  File "/usr/local/pdaq/pDAQ_current/cluster-config/subprocess.py", line 1007, in wait
    pid, sts = os.waitpid(self.pid, 0)
KeyboardInterrupt
Trying again to launch acquisition: 
pdaq@sps-expcont[~] 06:04:59 (1)$ DAQStatus.py
CNC localhost:8080
-----------------------
0 unused components
-----------------------
0 run sets



DAQ state is DAQRun DEAD
pdaq@sps-expcont[~] 06:05:58 (0)$ DAQLaunch.py
ssh_exchange_identification: Connection closed by remote host
ssh_exchange_identification: Connection closed by remote host
ssh_exchange_identification: Connection closed by remote host

Camille Parisel | 09 Dec 2008 00:18 GMT | Ice Cube/DAQ | | permalink