INTEGRALPlanckGaiaHitomiPOLARCHEOPSEuclidATHENA
HEAVENSFACTCTALOFTSPICAJEM-EUSOXIPEeXTPTheseus
XRISMMAGBOUNDSMARTNet
ISDCCDCI
INTEGRAL Science Data Centre

ISDC END OF REVOLUTION REPORT (NRT)
REVOLUTION 2336 - Report of March 10, 2021


                                                              
 Perigee Passage at start : 2021-02-25T04:22:09
 Perigee Passage at end   : 2021-02-27T20:12:24
 Radiation Belt exit      : 21203 km (ijd 7726.2227)
 Radiation Belt entrance  : 51696 km (ijd 7728.7020)

 1. Planning summary
 ===================

 1.1 General remarks
 
 a) 2021-02-25T21:44: Pointing 23, 24, 25, 26 missed.

 b) 2021-02-27T01:05: IREM crash.

 c) 2021-02-27T01:16: IREM crash.

 d) 2021-02-27T02:13: Pointing 62, 63, 64, 65, 66, 67, 68, 69 missed.

 1.2 Pointings summary

   Remarks: Exposure info from POD. Pointing info from TSF. 
 - Durations in exec/planned format; data gaps and bad time intervals not excluded from total time.
 - Deviations: only unexpected deviations >30 secs for pointings assigned to an exposure reported;
   expected deviations (first & last pointings of an exposure longer than planned) not reported. 

  • Exposure 23360001: 'Dummy pointing', staring (1x900s) 1 pointing: 23360002, 961s/900s (+1m01s)
  • Exposure 23360002: 'Dummy pointing', staring (1x900s) 1 pointing: 23360004, 963s/900s (+1m03s)
  • Exposure 23360003: 'Galactic Center', 5x5 (25x2000s) 25 pointings: 23360006 -> 23360030, 50378s/50000s (+6m18s) Deviations: 23360023 5572/2000s: see 1.1.a) 23360024 736/2000s: see 1.1.a) 23360025 0/2000s: see 1.1.a) 23360026 2066/2000s: see 1.1.a)
  • Exposure 23360004: 'Gal. Bulge region', hexagon (7x3600s) 7 pointings: 23360032 -> 23360038, 25169s/25200s (-30s)
  • Exposure 23360005: 'Dummy pointing', staring (1x900s) 1 pointing: 23360040, 964s/900s (+1m04s)
  • Exposure 23360006: 'Dummy pointing', staring (1x900s) 1 pointing: 23360042, 964s/900s (+1m04s)
  • Exposure 23360007: 'Orion_1', 5x5 (3x3330s) 3 pointings: 23360044 -> 23360046, 10052s/9990s (+1m02s)
  • Exposure 23360008: 'Orion_1', 5x5 (9x3330s) 9 pointings: 23360047 -> 23360055, 32609s/29970s (+43m59s)
  • Exposure 23360009: 'Crab', 5x5 (25x1800s) 25 pointings: 23360057 -> 23360081, 43789s/45000s (-20m10s) Deviations: 23360062 1866/1800s: see 1.1.d) 23360063 1912/1800s: see 1.1.d) 23360064 1936/1800s: see 1.1.d) 23360065 890/1800s: see 1.1.d) 23360066 0/1800s: see 1.1.d) 23360067 1247/1800s: see 1.1.d) 23360068 1920/1800s: see 1.1.d) 23360069 1866/1800s: see 1.1.d)
  • Exposure 23360010: 'Dummy pointing', staring (1x900s) 1 pointing: 23360083, 3595s/900s (+44m55s)
  • Pointings with no assigned Exposure 11 pointings: 23360001, 0003, 0005, 0031, 0039, 0041, 0043, 0056, 69992096, 0084, 0085 27939s/6220s (+6h01m59s)
2. NRT Data processing ====================== 2.1 Telemetry * TM gaps of more than 30 seconds: 2021-02-25T20:45:15 - 2021-02-25T21:42:05 2021-02-26T13:58:41 2021-02-26T13:59:12 * Frames missed: 2021-02-25T21:44:38 935 frames missed (824530119 to 824531053) * Statistics: Mean Rate: 15.71 frames/sec (mean) Frames: 3299952 total : 0 missed : 2816517 TM : 483435 idle : 0 invalid Packets: 5648087 total : 37890 missed : 5633034 TM : 0 tcmd : 15053 time : 0 idle : 0 invalid * No error 2.2 Auxiliary files OLF: 63 ASF: 78 THF: 61 2.3 Pre-processing / OPUS pipelines Nothing special * No error 2.4 ISGRI context table 2021-02-27T07:21: IIMG_SDCMOC_D20210225081248_00001.INT sent to MOC 2021-02-27T11:40: IIMG_SDCMOC_D20210225081248_00002.INT sent to MOC 2nd version provided by IRFU/SAp, Saclay (F) 3. Alerts ========= 3.1 All alerts except OOLs and missing scientific data * Level 3: 101 Can't (re)connect to MOC (ECONNREFUSED). Line OK. TM transmitter not responding Program / version that has created this alert: rttmd 2.2.0 Directory of alert generation: /isdc2/run/alert/nrt_dr 2021-02-25T21:42:26 305 IBIS synchronization failed too many times, 3000 times! Program / version that has created this alert: Preproc 5.8 Directory of alert generation: /isdc2/run/alert/nrt_pp Preproc seems unable to resynchronize the IBIS time!!! Preproc must be restarted? * Level 2: 603 The pointing hasn't increased by one. From 23 to 27 (2336_0002_AHF) -> see 1.1.a) 7000 IREM STANDARD MODE Program / version that has created this alert: Preproc 5.8 Directory of alert generation: /isdc2/run/alert/nrt_pp IREM SHOULD BE IN INTEGRAL MODE AT ANYTIME, Please verify it's expected to get this mode! -> see 1.1.b) -> see 1.1.c) 603 The pointing hasn't increased by one. From 61 to 9503 (2336_0002_AHF) -> see 1.1.d) * Level 1: 3041 Check NEW context from orbit 2336 (on 2021-02-25T08:12:48) Program / version that has created this alert: ibis_isgr_low_thres 7.8 Directory of alert generation: /isdc/run2/pipelines/nrt/nrtrev/scratch/2336_20210225081248_00_ilt Number of DEAD: 914 (limit is 890) Number NEW DEAD: 4 (limit is 9) 604 Exposure time is 5577 sec. instead of 2000 sec. Pointing ID (BCPPID): 23360023 -> see 1.1.a) 604 Exposure time is 736 sec. instead of 2000 sec. Pointing ID (BCPPID): 23360024 -> see 1.1.a) 604 Exposure time is 2062 sec. instead of 2000 sec. Pointing ID (BCPPID): 23360026 -> see 1.1.a) 605 OMC: The mode differ for 1704 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600270010.000 from 2021-02-25T22:33:26 to 2021-02-25T22:33:32 expected mode : 42 actual mode: 21 from 2021-02-25T22:38:12 to 2021-02-25T23:06:30 expected mode : 42 actual mode: 21 5099 HI__ANODE__REJECT was out of limit during 8 sec. Max value: 1.0027e+04 Program / version that has created this alert: osm_monitor 1.4.1 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600280010.000 Science Window ID: 233600280010 from 2021-02-25T23:41:31 (UTC) to 2021-02-25T23:41:31 (UTC): alert level: 1, limit value: 10000, max value: 10027, mean value: 10027 605 IBIS: The mode differ for 599 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600570010.000 from 2021-02-26T23:21:39 to 2021-02-26T23:31:38 expected mode : 41 actual mode: 22 605 OMC: The mode differ for 610 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600570010.000 from 2021-02-26T23:01:36 to 2021-02-26T23:01:48 expected mode : 42 actual mode: 21 from 2021-02-26T23:21:40 to 2021-02-26T23:31:38 expected mode : 42 actual mode: 22 605 IBIS: The mode differ for 1801 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600580010.000 from 2021-02-26T23:33:33 to 2021-02-27T00:03:34 expected mode : 41 actual mode: 22 605 OMC: The mode differ for 1801 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600580010.000 from 2021-02-26T23:33:33 to 2021-02-26T23:53:40 expected mode : 42 actual mode: 22 from 2021-02-26T23:53:40 to 2021-02-27T00:03:34 expected mode : 42 actual mode: 21 605 IBIS: The mode differ for 1799 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600590010.000 from 2021-02-27T00:05:47 to 2021-02-27T00:35:46 expected mode : 41 actual mode: 22 605 IBIS: The mode differ for 908 sec. from the planning Program / version that has created this alert: osm_timeline 1.14 Directory of alert generation: /isdc/nrt2/ops/scw/2336/233600600010.000 from 2021-02-27T00:37:59 to 2021-02-27T00:53:07 expected mode : 41 actual mode: 22 604 Exposure time is 1872 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360062 -> see 1.1.d) 604 Exposure time is 1912 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360063 -> see 1.1.d) 604 Exposure time is 1936 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360064 -> see 1.1.d) 604 Exposure time is 884 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360065 -> see 1.1.d) 604 Exposure time is 1252 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360067 -> see 1.1.d) 6099 CENT__INFO was out of limit during 1240 sec. Min value: 0.0000e+00 Scw: 233600670010 from 2021-02-27T04:33:32 (UTC) to 2021-02-27T04:54:04 (UTC): alert level: 1, limit value: 3, min value: 0, mean value: 0 604 Exposure time is 1920 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360068 -> see 1.1.d) 6099 CENT__INFO was out of limit all the time. Min value: 0.0000e+00 Scw: 233600680010 from 2021-02-27T04:54:12 (UTC) to 2021-02-27T05:26:04 (UTC): alert level: 1, limit value: 3, min value: 0, mean value: 0 604 Exposure time is 1860 sec. instead of 1800 sec. Pointing ID (BCPPID): 23360069 -> see 1.1.d) 6099 CENT__INFO was out of limit all the time. Min value: 0.0000e+00 Scw: 233600690010 from 2021-02-27T05:26:12 (UTC) to 2021-02-27T05:57:08 (UTC): alert level: 1, limit value: 3, min value: 0, mean value: 0 3.2 Parameter out of limits IBIS: ----- Due to Solar minimum, the IBIS veto limits are not appropriate resulting in too many alerts ScWs: 233600020010 - 233600830010 V1S_MBOT_MCOUNT V1S_MLAT_MCOUNT ScWs: 233600020010 - 233600830010 IOE_MDOS_MMCE4,6 3.3 Missing scientific data (taken from alert 3050) IBIS: ----- ScWs: 233600070010, 233600230010, 233600240010, 233600260010 233600600010, 233600650010, 233600670010 These data structures are missing: PICS-SIMH-RAW (or ALL) for mode Observation standard (41) PICS-SISH-RAW (or ALL) for mode Observation standard (41) OMC: ---- ScW: 223600670010 These data structures are missing: OMC.-SHOT-RAW (or ALL) for mode Science Normal (42) 4. Instruments checks (IOSM) ===================== Nothing special 5. Science ========== 5.1 Summary a) Planned observations Last POD file: /isdc/nrt2/ops/aux/adp/2336.000/pod_2336_0001.fits.gz Received at : 15 Feb 13:45 i EXP_ID OBS_ID SRC_NAME POINT_NUM POINT_LEN 1 23360001 88803860001 Dummy pointing 1 900 2 23360002 88803860002 Dummy pointing 1 900 3 23360003 18200210003 Galactic Center 25 2000 4 23360004 18200010008 Gal. Bulge region 7 3600 5 23360005 88803860003 Dummy pointing 1 900 6 23360006 88803860004 Dummy pointing 1 900 7 23360007 17200140001 Orion_1 3 3330 8 23360008 17200140001 Orion_1 9 3330 9 23360009 18600010002 Crab 25 1800 10 23360010 88803860005 Dummy pointing 1 900 b) Solar activity & miscellaneous Calm 5.2 IBAS: no more reported here 5.3 TOOs: No