ISDC END OF REVOLUTION REPORT (NRT)
REVOLUTION 2336 - Report of March 10, 2021
Perigee Passage at start : 2021-02-25T04:22:09
Perigee Passage at end : 2021-02-27T20:12:24
Radiation Belt exit : 21203 km (ijd 7726.2227)
Radiation Belt entrance : 51696 km (ijd 7728.7020)
1. Planning summary
===================
1.1 General remarks
a) 2021-02-25T21:44: Pointing 23, 24, 25, 26 missed.
b) 2021-02-27T01:05: IREM crash.
c) 2021-02-27T01:16: IREM crash.
d) 2021-02-27T02:13: Pointing 62, 63, 64, 65, 66, 67, 68, 69 missed.
1.2 Pointings summary
Remarks: Exposure info from POD. Pointing info from TSF.
- Durations in exec/planned format; data gaps and bad time intervals not excluded from total time.
- Deviations: only unexpected deviations >30 secs for pointings assigned to an exposure reported;
expected deviations (first & last pointings of an exposure longer than planned) not reported.
- Exposure 23360001: 'Dummy pointing', staring (1x900s)
1 pointing: 23360002, 961s/900s (+1m01s)
- Exposure 23360002: 'Dummy pointing', staring (1x900s)
1 pointing: 23360004, 963s/900s (+1m03s)
- Exposure 23360003: 'Galactic Center', 5x5 (25x2000s)
25 pointings: 23360006 -> 23360030, 50378s/50000s (+6m18s)
Deviations:
23360023 5572/2000s: see 1.1.a)
23360024 736/2000s: see 1.1.a)
23360025 0/2000s: see 1.1.a)
23360026 2066/2000s: see 1.1.a)
- Exposure 23360004: 'Gal. Bulge region', hexagon (7x3600s)
7 pointings: 23360032 -> 23360038, 25169s/25200s (-30s)
- Exposure 23360005: 'Dummy pointing', staring (1x900s)
1 pointing: 23360040, 964s/900s (+1m04s)
- Exposure 23360006: 'Dummy pointing', staring (1x900s)
1 pointing: 23360042, 964s/900s (+1m04s)
- Exposure 23360007: 'Orion_1', 5x5 (3x3330s)
3 pointings: 23360044 -> 23360046, 10052s/9990s (+1m02s)
- Exposure 23360008: 'Orion_1', 5x5 (9x3330s)
9 pointings: 23360047 -> 23360055, 32609s/29970s (+43m59s)
- Exposure 23360009: 'Crab', 5x5 (25x1800s)
25 pointings: 23360057 -> 23360081, 43789s/45000s (-20m10s)
Deviations:
23360062 1866/1800s: see 1.1.d)
23360063 1912/1800s: see 1.1.d)
23360064 1936/1800s: see 1.1.d)
23360065 890/1800s: see 1.1.d)
23360066 0/1800s: see 1.1.d)
23360067 1247/1800s: see 1.1.d)
23360068 1920/1800s: see 1.1.d)
23360069 1866/1800s: see 1.1.d)
- Exposure 23360010: 'Dummy pointing', staring (1x900s)
1 pointing: 23360083, 3595s/900s (+44m55s)
- Pointings with no assigned Exposure
11 pointings: 23360001, 0003, 0005, 0031, 0039, 0041, 0043, 0056,
69992096, 0084, 0085
27939s/6220s (+6h01m59s)
2. NRT Data processing
======================
2.1 Telemetry
* TM gaps of more than 30 seconds:
2021-02-25T20:45:15 - 2021-02-25T21:42:05
2021-02-26T13:58:41
2021-02-26T13:59:12
* Frames missed:
2021-02-25T21:44:38 935 frames missed (824530119 to 824531053)
* Statistics: Mean Rate: 15.71 frames/sec (mean)
Frames: 3299952 total
: 0 missed
: 2816517 TM
: 483435 idle
: 0 invalid
Packets: 5648087 total
: 37890 missed
: 5633034 TM
: 0 tcmd
: 15053 time
: 0 idle
: 0 invalid
* No error
2.2 Auxiliary files
OLF: 63
ASF: 78
THF: 61
2.3 Pre-processing / OPUS pipelines
Nothing special
* No error
2.4 ISGRI context table
2021-02-27T07:21: IIMG_SDCMOC_D20210225081248_00001.INT sent to MOC
2021-02-27T11:40: IIMG_SDCMOC_D20210225081248_00002.INT sent to MOC
2nd version provided by IRFU/SAp, Saclay (F)
3. Alerts
=========
3.1 All alerts except OOLs and missing scientific data
* Level 3:
101 Can't (re)connect to MOC (ECONNREFUSED). Line OK. TM transmitter not responding
Program / version that has created this alert: rttmd 2.2.0
Directory of alert generation: /isdc2/run/alert/nrt_dr
2021-02-25T21:42:26
305 IBIS synchronization failed too many times, 3000 times!
Program / version that has created this alert: Preproc 5.8
Directory of alert generation: /isdc2/run/alert/nrt_pp
Preproc seems unable to resynchronize the IBIS time!!! Preproc must be restarted?
* Level 2:
603 The pointing hasn't increased by one. From 23 to 27 (2336_0002_AHF)
-> see 1.1.a)
7000 IREM STANDARD MODE
Program / version that has created this alert: Preproc 5.8
Directory of alert generation: /isdc2/run/alert/nrt_pp
IREM SHOULD BE IN INTEGRAL MODE AT ANYTIME, Please verify it's expected to get this mode!
-> see 1.1.b)
-> see 1.1.c)
603 The pointing hasn't increased by one. From 61 to 9503 (2336_0002_AHF)
-> see 1.1.d)
* Level 1:
3041 Check NEW context from orbit 2336 (on 2021-02-25T08:12:48)
Program / version that has created this alert: ibis_isgr_low_thres 7.8
Directory of alert generation: /isdc/run2/pipelines/nrt/nrtrev/scratch/2336_20210225081248_00_ilt
Number of DEAD: 914 (limit is 890)
Number NEW DEAD: 4 (limit is 9)
604 Exposure time is 5577 sec. instead of 2000 sec.
Pointing ID (BCPPID): 23360023
-> see 1.1.a)
604 Exposure time is 736 sec. instead of 2000 sec.
Pointing ID (BCPPID): 23360024
-> see 1.1.a)
604 Exposure time is 2062 sec. instead of 2000 sec.
Pointing ID (BCPPID): 23360026
-> see 1.1.a)
605 OMC: The mode differ for 1704 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600270010.000
from 2021-02-25T22:33:26 to 2021-02-25T22:33:32 expected mode : 42 actual mode: 21
from 2021-02-25T22:38:12 to 2021-02-25T23:06:30 expected mode : 42 actual mode: 21
5099 HI__ANODE__REJECT was out of limit during 8 sec. Max value: 1.0027e+04
Program / version that has created this alert: osm_monitor 1.4.1
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600280010.000
Science Window ID: 233600280010
from 2021-02-25T23:41:31 (UTC) to 2021-02-25T23:41:31 (UTC):
alert level: 1, limit value: 10000, max value: 10027, mean value: 10027
605 IBIS: The mode differ for 599 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600570010.000
from 2021-02-26T23:21:39 to 2021-02-26T23:31:38 expected mode : 41 actual mode: 22
605 OMC: The mode differ for 610 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600570010.000
from 2021-02-26T23:01:36 to 2021-02-26T23:01:48 expected mode : 42 actual mode: 21
from 2021-02-26T23:21:40 to 2021-02-26T23:31:38 expected mode : 42 actual mode: 22
605 IBIS: The mode differ for 1801 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600580010.000
from 2021-02-26T23:33:33 to 2021-02-27T00:03:34 expected mode : 41 actual mode: 22
605 OMC: The mode differ for 1801 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600580010.000
from 2021-02-26T23:33:33 to 2021-02-26T23:53:40 expected mode : 42 actual mode: 22
from 2021-02-26T23:53:40 to 2021-02-27T00:03:34 expected mode : 42 actual mode: 21
605 IBIS: The mode differ for 1799 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600590010.000
from 2021-02-27T00:05:47 to 2021-02-27T00:35:46 expected mode : 41 actual mode: 22
605 IBIS: The mode differ for 908 sec. from the planning
Program / version that has created this alert: osm_timeline 1.14
Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600600010.000
from 2021-02-27T00:37:59 to 2021-02-27T00:53:07 expected mode : 41 actual mode: 22
604 Exposure time is 1872 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360062
-> see 1.1.d)
604 Exposure time is 1912 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360063
-> see 1.1.d)
604 Exposure time is 1936 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360064
-> see 1.1.d)
604 Exposure time is 884 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360065
-> see 1.1.d)
604 Exposure time is 1252 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360067
-> see 1.1.d)
6099 CENT__INFO was out of limit during 1240 sec. Min value: 0.0000e+00
Scw: 233600670010
from 2021-02-27T04:33:32 (UTC) to 2021-02-27T04:54:04 (UTC):
alert level: 1, limit value: 3, min value: 0, mean value: 0
604 Exposure time is 1920 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360068
-> see 1.1.d)
6099 CENT__INFO was out of limit all the time. Min value: 0.0000e+00
Scw: 233600680010
from 2021-02-27T04:54:12 (UTC) to 2021-02-27T05:26:04 (UTC):
alert level: 1, limit value: 3, min value: 0, mean value: 0
604 Exposure time is 1860 sec. instead of 1800 sec.
Pointing ID (BCPPID): 23360069
-> see 1.1.d)
6099 CENT__INFO was out of limit all the time. Min value: 0.0000e+00
Scw: 233600690010
from 2021-02-27T05:26:12 (UTC) to 2021-02-27T05:57:08 (UTC):
alert level: 1, limit value: 3, min value: 0, mean value: 0
3.2 Parameter out of limits
IBIS:
-----
Due to Solar minimum, the IBIS veto limits are not appropriate
resulting in too many alerts
ScWs: 233600020010 - 233600830010
V1S_MBOT_MCOUNT
V1S_MLAT_MCOUNT
ScWs: 233600020010 - 233600830010
IOE_MDOS_MMCE4,6
3.3 Missing scientific data (taken from alert 3050)
IBIS:
-----
ScWs: 233600070010, 233600230010, 233600240010, 233600260010
233600600010, 233600650010, 233600670010
These data structures are missing:
PICS-SIMH-RAW (or ALL) for mode Observation standard (41)
PICS-SISH-RAW (or ALL) for mode Observation standard (41)
OMC:
----
ScW: 223600670010
These data structures are missing:
OMC.-SHOT-RAW (or ALL) for mode Science Normal (42)
4. Instruments checks (IOSM)
=====================
Nothing special
5. Science
==========
5.1 Summary
a) Planned observations
Last POD file: /isdc/nrt2/ops/aux/adp/2336.000/pod_2336_0001.fits.gz
Received at : 15 Feb 13:45
i EXP_ID OBS_ID SRC_NAME POINT_NUM POINT_LEN
1 23360001 88803860001 Dummy pointing 1 900
2 23360002 88803860002 Dummy pointing 1 900
3 23360003 18200210003 Galactic Center 25 2000
4 23360004 18200010008 Gal. Bulge region 7 3600
5 23360005 88803860003 Dummy pointing 1 900
6 23360006 88803860004 Dummy pointing 1 900
7 23360007 17200140001 Orion_1 3 3330
8 23360008 17200140001 Orion_1 9 3330
9 23360009 18600010002 Crab 25 1800
10 23360010 88803860005 Dummy pointing 1 900
b) Solar activity & miscellaneous
Calm
5.2 IBAS: no more reported here
5.3 TOOs: No
|