ISDC END OF REVOLUTION REPORT (NRT)
REVOLUTION 1229 - Report of November 8, 2012
Perigee Passage at start : 2012-11-05T09:49:48
Perigee Passage at end : 2012-11-08T09:37:38
Radiation Belt exit : 55412 km (ijd 4692.5713)
Radiation Belt entrance : 26221 km (ijd 4695.3464)
Operations Coordinator : Enrico Bozzo
Pipeline Operator : Ph.M.
Scientist on Duty : Lucia Pavan
1. Planning summary
===================
1.1 General remarks
a) JEM-X 1 and 2 on.
b) 2012-11-05T12:30: Missing mount point on nrt machine, all processings hanged,
including data receipt. Resolved at around 16:30.
c) 2012-11-06T02:30: IBIS VETO OEMS, "Time-out sending LSL".
It was due to an LCL trip on the VETO electronics.
Due to this MOC had to put IBIS in stand-by mode twice, first from 5:20z to 6:17z,
and then again from 8:26z to 9:15z.
d) 2012-11-06T08:30: Preproc restarted, was rejecting ISGRI packets.
2012-11-06T11:14: Preproc not able to write alerts to alert directory,
then in undefined state after shut down command sent.
2012-11-06T13:14: Preproc restarted after preproc machine reboot.
e) 2012-11-06T03:42: PICsIT spurious reset, no HEPI resync.
2012-11-06T07:02: PICsIT spurious reset, no HEPI resync.
f) 2012-11-07T21:28: Guide star lost, AIMU went on, pointing 64 lost.
1.2 Pointings summary
Remarks: Only Science Windows (ScWs) of type 'pointing' are considered.
- Exposures info from POD version 1. Pointings info from TSF version 7.
- Durations in exec/planned format; data gaps and bad time intervals not excluded from total time.
- Deviations: only unexpected deviations >30 secs for pointings assigned to an exposure reported;
expected deviations (first & last pointings of an exposure longer than planned) not reported.
- Exposure 12290001: 'GPS-Scan-30', GPS (10x2200s)
10 pointings: 12290004 -> 12290013, 16577s/22000s (-1h30m23s)
Deviations:
12290004 0/2200s: see 1.1.b)
12290005 0/2200s: see 1.1.b)
12290006 1160/2200s: see 1.1.b)
12290007 2292/2200s: see 1.1.b)
- Exposure 12290002: 'GPS-Scan-30', GPS (5x2200s)
5 pointings: 12290014 -> 12290018, 10849s/11000s (-2m30s)
- Exposure 12290003: 'GRS 1915+105', hexagon (8x2857s)
8 pointings: 12290020 -> 12290027, 23825s/22856s (+16m09s)
Deviations:
12290023 2826/2857s: see 1.1.c)
- Exposure 12290004: 'GPS-Scan-30', GPS (10x2200s)
10 pointings: 12290029 -> 12290038, 21054s/22000s (-15m46s)
Deviations:
12290029 0/2200s: see 1.1.d)
- Exposure 12290005: 'GPS-Scan-30', GPS (1x2200s)
1 pointing: 12290039, 2280s/2200s (+1m19s)
- Exposure 12290006: 'GPS-Scan-30', GPS (7x2200s)
7 pointings: 12290040 -> 12290046, 15201s/15400s (-3m18s)
- Exposure 12290007: 'M82 X-1', 5x5 (1x3479s)
1 pointing: 12290048, 3508s/3479s (+28s)
- Exposure 12290008: 'M82 X-1', 5x5 (12x3479s)
12 pointings: 12290049 -> 12290060, 45676s/41748s (+1h05m27s)
- Exposure 12290009: 'M82 X-1', 5x5 (12x3479s)
12 pointings: 12290061 -> 12290072, 42295s/41748s (+9m07s)
Deviations:
12290064 1343/3479s: see 1.1.e)
- Pointings with no assigned Exposure
8 pointings: 12290001, 0002, 0003, 0019, 0028, 0047, 0073, 0074, 15242s/4639s (+2h56m43s)
2. NRT Data processing
======================
2.1 Telemetry
* Start reception: 2012-11-05T11:30:53
End reception: 2012-11-08T08:10:06
* TM gaps of more than 30 seconds:
2012-11-05T11:30:53
2012-11-05T13:06:18
2012-11-05T16:23:42
2012-11-05T16:29:34
2012-11-05T16:48:06 - 2012-11-05T16:57:43
2012-11-05T17:16:50
2012-11-05T17:48:08
2012-11-05T19:26:08
2012-11-05T21:50:30
2012-11-05T23:11:33
2012-11-05T23:20:09
2012-11-06T00:16:49
2012-11-06T03:44:23
2012-11-06T16:38:55 - 2012-11-06T16:39:26
2012-11-06T19:28:26
2012-11-06T19:51:35
* Frames missed:
2012-11-05T11:30:54 655 frames missed (3823398586 to 3823399240)
2012-11-05T13:06:18 659 frames missed (3823490170 to 3823490828)
2012-11-05T16:23:43 481 frames missed (3823679637 to 3823680117)
2012-11-05T16:29:35 480 frames missed (3823685269 to 3823685748)
2012-11-05T16:48:07 481 frames missed (3823703061 to 3823703541)
2012-11-05T17:05:01 16073 frames missed (3823703694 to 3823719766)
2012-11-05T17:16:50 309 frames missed (3823730473 to 3823730781)
2012-11-05T17:16:51 342 frames missed (3823730784 to 3823731125)
2012-11-05T17:48:08 240 frames missed (3823760654 to 3823760893)
2012-11-05T17:48:09 209 frames missed (3823760964 to 3823761172)
2012-11-05T19:26:09 494 frames missed (3823854757 to 3823855250)
2012-11-05T21:50:30 279 frames missed (3823993150 to 3823993428)
2012-11-05T21:50:31 385 frames missed (3823993459 to 3823993843)
2012-11-05T23:11:33 309 frames missed (3824071144 to 3824071452)
2012-11-05T23:11:33 181 frames missed (3824071456 to 3824071636)
2012-11-05T23:20:09 240 frames missed (3824079370 to 3824079609)
2012-11-05T23:20:09 207 frames missed (3824079680 to 3824079886)
2012-11-05T23:23:59 1381 frames missed (3824082194 to 3824083574)
2012-11-06T00:16:49 565 frames missed (3824133725 to 3824134289)
2012-11-06T03:44:25 753 frames missed (3824332833 to 3824333585)
2012-11-06T16:38:55 157 frames missed (3825076476 to 3825076632)
2012-11-06T16:39:27 905 frames missed (3825076710 to 3825077614)
2012-11-06T19:28:53 914 frames missed (3825239357 to 3825240270)
2012-11-06T19:51:37 592 frames missed (3825261502 to 3825262093)
* ERT not in sync with UTC: -
* Statistics: Mean Rate: 15.88 frames/sec (mean)
Frames: 3947370 total Packets: 5321260 total
: 0 missed : 67144 missed
: 2742946 TM : 5304185 TM
: 1204424 idle : 0 tcmd
: 0 invalid : 17075 time
: 0 idle
: 0 invalid
* Errors:
NCTRSFRAME: invalid quality = 256 (should be 0 or 1):
2012-11-05T15:56:26 - 2012-11-05T15:57:00
2012-11-07T05:39:55 - 2012-11-07T05:40:26
2012-11-07T05:52:33 - 2012-11-07T05:52:34
2012-11-07T05:56:37 - 2012-11-07T05:57:01
2012-11-07T06:21:03 - 2012-11-07T06:21:39
2012-11-07T10:24:50 - 2012-11-07T10:25:40
2012-11-07T10:27:10 - 2012-11-07T10:27:13
2012-11-07T10:35:06 - 2012-11-07T10:35:38
2012-11-07T11:13:34
2012-11-07T11:20:12 - 2012-11-07T11:20:26
2012-11-07T11:26:34 - 2012-11-07T11:27:14
2012-11-07T12:06:59 - 2012-11-07T12:07:46
2012-11-07T12:15:58 - 2012-11-07T12:16:42
2.2 Auxiliary files summary
POD OPP TSF PAF OLF ASF AHF THF ORB REVNO
-------------------------------------------------------------
1 1 2 2 72 81 1 92 1 1
2.3 Pre-processing
* Frequent errors for days 2012-11-05, 2012-11-06, 2012-11-07, respectively:
16 24 23 "Histogram rejected"
188004 126542 0 "OBT found too much higher"
4 12 6 "packet(s) of the Histogram are discarded"
2 19 3 "Can not store the Histogram"
0 0 0 "SpiSpectrum, decompression failed"
0 0 0 "SpiSpectrumParser, Failure"
-> Preprocessing lost IBIS packets synchronization on Nov 5.
2.4 OPUS Pipelines processing
* REV: completed | errors * INPUT/SCW: completed | errors
------------------------------- ----------------------------
IREM : 70 | 0 149 | 0
ISGRI_cal : 22 | 0
ISGRI_noise: 130 | 1
IBIS_veto : 24 | 0 * QLA completed | errors
PICsIT_cal : 39 | 0 -----------------------------
JMX : 258 | 2 IBIS : 71 | 0
ilt : 1 | 0 JEMX-1 : " | 0
Archiving : 1 | 0 JEMX-2 : " | 0
2.5 ISGRI context table
2012-11-T: IIMG_SDCMOC_D_00001.INT sent to MOC
2012-11-T: IIMG_SDCMOC_D_00002.INT sent to MOC
2nd version provided by IRFU/SAp, Saclay (F)
* Errors:
Date: 20121105165118 OSF: 1229_20121105160327_00_irn Stat: cxw Last: /bin/chmod Exit: See next line
... file /isdc/nrt/ops//scw//1229/rev.000/cfg/isgri_pxlswtch_20121105160327.fits exists already
Date: 20121106105146 OSF: 1229_20121106102731_00_jm1 Stat: cxw Last: j_prp_frss_obt Exit: 1409
Date: 20121106105146 OSF: 1229_20121106102738_00_jm2 Stat: cxw Last: j_prp_frss_obt Exit: 1409
Date: 20121106143507 OSF: 122900270042 Stat: cxwww Last: spi_dp_derived_param Exit: 25005
Date: 20121106144107 OSF: 122900270051 Stat: cxwww Last: dp_aux_attr Exit: 25005
Date: 20121106151707 OSF: 122900280010 Stat: cxwww Last: spi_dp_derived_param Exit: 25005
Date: 20121106151707 OSF: 122900280021 Stat: cxwww Last: spi_dp_derived_param Exit: 25005
Date: 20121106160008 OSF: 122900290010 Stat: cxwww Last: spi_dp_derived_param Exit: 25005
-> due to network issue with preproc machine
3. Alerts
=========
3.1 All alerts except OOLs and missing scientific data
* Level 3:
101 Can't (re)connect to MOC (ECONNREFUSED). Line OK. TM transmitter not responding.
2012-11-05T16:58:27
2012-11-05T23:22:44
2012-11-06T19:28:37
212 rttm_maq_read() says it missed 1 packets
2012-11-05T16:06:39
-> see 1.1.d)
* Level 2:
303 Fail to read raw telemetry file, error# : -1106
Program / version that has created this alert: Preproc 5.8
Please verify why this error occured, the raw telemetry file /isdc/nrt/pck/1229/tm2012110610402600.fits
could be missing!
303 Fail to read raw telemetry file, error# : -1106
Program / version that has created this alert: Preproc 5.8
Please verify why this error occured, the raw telemetry file /isdc/nrt/pck/1229/tm2012110610470800.fits
could be missing!
2012-11-06T10:47:15
2012-11-06T10:53:57
-> network issue, see 1.1.d)
603 The pointing hasn't increased by one. From 27 to 9085
Program / version that has created this alert: convertattitude 2.4
Directory of alert generation: /export/isdc/run/pipelines/adp/adp/scratch/1229_0030_ASF
Convert attitude RRRR=1229 ROW=30. Missing pointing ?
-> as planned
603 The pointing hasn't increased by one. From 9085 to 9087
Program / version that has created this alert: convertattitude 2.4
Directory of alert generation: /export/isdc/run/pipelines/adp/adp/scratch/1229_0031_ASF
Convert attitude RRRR=1229 ROW=31. Missing pointing ?
-> as planned
603 The pointing hasn't increased by one. From 27 to 86
From attitude history: 1229_0001_AHF
Convert attitude RRRR=1229 ROW=918. Missing pointing ?
-> as it was planned
603 The pointing hasn't increased by one. From 63 to 65
From attitude history: 1229_0001_AHF
Convert attitude RRRR=1229 ROW=3836. Missing pointing ?
-> see 1.1.f)
* Level 1:
604 Exposure time is 1161 sec. instead of 2200 sec.
Pointing ID (BCPPID): 12290006
604 Exposure time is 2293 sec. instead of 2200 sec.
Pointing ID (BCPPID): 12290007
604 Exposure time is 2158 sec. instead of 2200 sec.
Pointing ID (BCPPID): 12290009
-> see 1.1.b)
604 Exposure time is 1342 sec. instead of 3479 sec.
Pointing ID (BCPPID): 12290064
-> see 1.1.f)
605 IBIS: The mode differ for 78 sec. from the planning
ScW: 122900240010
from 2012-11-06T05:19:45 to 2012-11-06T05:21:03 expected mode: 41 actual mode: 22
605 IBIS: The mode differ for 126 sec. from the planning
ScW: 122900240021
from 2012-11-06T05:21:03 to 2012-11-06T05:23:09 expected mode: 41 actual mode: 22
605 IBIS: The mode differ for 2857 sec. from the planning
ScW: 122900250010
from 2012-11-06T05:23:09 to 2012-11-06T06:10:46 expected mode: 41 actual mode: 22
605 IBIS: The mode differ for 116 sec. from the planning
ScW: 122900250021
from 2012-11-06T06:10:46 to 2012-11-06T06:12:42 expected mode: 41 actual mode: 22
605 IBIS: The mode differ for 343 sec. from the planning
ScW: 122900260010
from 2012-11-06T06:12:42 to 2012-11-06T06:18:25 expected mode: 41 actual mode: 22
-> see 1.1.c)
3.2 Parameter out of limits
IBIS:
-----
ScW: 122900210010 - 122900240010
from 2012-11-06T02:33:02 (UTC) to 2012-11-06T02:44:14 (UTC)
V0E_MVDM[1-16]HPVS
V1S_MVDM[1-16]HV
V0E_MVDM[1-16]BGO
V1S_MCDM01HV
V1S_MCDM01STAT
V1S_MVDMCDMCURR
V0E_MVDM[1-16]VM5M
V1E_MVEB_MTEMP
V1E_MH4_MVECU5V
V1E_MH4_MIFB_MANV
V1E_MH4_MMOD28V
V1E_MVEB_MTEMP
V1E_MH4_MVECU_MAPV
V0E_MVDM07VC5M
V0E_MVDM04VC5P
P0S_MM[1-8]VTC
ScW: 122900210010 - 122900240010
PICsIT spurious reset in ScW 122900220021 and 122900260021
P0S_MM[1-8]LTC1
P0S_MM[1-8]LTC2
P0S_MM[1-8]RTC1
P0S_MM[1-8]RTC2
P0E_MMMCRER
from 2012-11-06T03:42:01 (UTC) to 2012-11-06T03:43:21 (UTC):
3.3 Missing scientific data
IBIS:
-----
ScW: 122900060010,122900230010 - 122900240010, 122900630010
These data structures are missing:
PICS-SIMH-RAW (or ALL) for mode Observation standard (41)
PICS-SISH-RAW (or ALL) for mode Observation standard (41)
4. Instruments checks (IOSM)
=====================
Nothing special
5. Science (LP)
==========
5.1 Summary
a) Planned observations
Last POD file: /isdc/nrt/ops/aux/adp/1229.000/pod_1229_0001.fits
Received at : 30 Oct 14:22
i EXP_ID OBS_ID SRC_NAME POINT_NUM POINT_LEN
1 12290001 09200050070 GPS-Scan-30 10 2200
2 12290002 09200050070 GPS-Scan-30 5 2200
3 12290003 09200080023 GRS 1915+105 8 2857
4 12290004 09200050071 GPS-Scan-30 10 2200
5 12290005 09200050071 GPS-Scan-30 1 2200
6 12290006 09200050071 GPS-Scan-30 7 2200
7 12290007 09200140001 M82 X-1 1 3479
8 12290008 09200140001 M82 X-1 12 3479
9 12290009 09200140001 M82 X-1 12 3479
b) Solar activity & miscellaneous
low
5.2 IBAS
a) GRB in ISGRI FOV: No
b) GRB in SPI-ACS:
2012-11-07T12:16:03: Possible short GRB121107A.
c) Other IBAS alerts: No
5.3 TOOs
None
6. Anomalies report:
====================
No anomaly
|
