Netcentric Multi-INT Fusion Targeting Initiative (NCMIFTI)



D.C. Linne von Berg, M.R. Kruer, J.N. Lee, M.D. Duncan, J.G. Howard, F. Olchowski, and R.A. Patten
Optical Sciences Division

Introduction: The NRL Optical Sciences Division has initiated a multiyear effort to develop and demonstrate an airborne netcentric suite of multi-intelligence (multi-INT) sensors and exploitation systems for real-time target detection and targeting product dissemination. The goal of this effort is to develop an airborne real-time intelligence-gathering and targeting system that can be used to detect concealed, camouflaged, and mobile targets. The multi-INT sensor suite includes high-resolution visible/infrared (EO/IR) dual-band cameras, visible-to-near infrared, short-wave, and long-wave infrared (VNIR/SWIR/LWIR) hyperspectral (HSI) sensors, synthetic aperture radar (SAR), electronics intelligence sensors (ELINT), and off-board networked sensors. Other sensors are also being considered for inclusion in the sensor suite to address unique target detection needs. The purpose of integrating a suite of multi-INT sensors on a single platform is to optimally perform real-time fusion of the onboard sensor streams in order to improve the detection probability and reduce the false alarms that occur in reconnaissance systems that use single sensor types on separate platforms, or use independent target-detection algorithms on multiple sensors. In addition to the integration and fusion of the multi-INT sensors, the NCMIFTI effort is establishing an open systems netcentric architecture that will provide a modular "plug and play" capability for additional system components and provide distributed connectivity to multiple sites for remote system control and exploitation.

Netcentric Architecture: The NCMIFTI system consists of two main subsystems, the control and display stations (CADS) and the airborne sensor/avionics/fusion components. The CADS system was developed to be platform-independent and allows for the reuse of the system software on multiple hardware configurations, depending on mission needs. Already demonstrated hardware configurations range from TAC-4 rack VME RaceWay-UNIX based systems for shipboard installation, to ruggedized HMMWV/P-3 systems, to laptop and desktop PC units (Fig. 5). The input and output interfaces to the CADS systems include various tactical control, imagery, and data RF links, multiple tape and solid state recorder interfaces, and Ethernet/ATM network connectivity, in addition to the operator interface. The NCMIFTI avionics components include the multi-INT sensor systems, the system control and sensor fusion processing electronics, and the airborne communication links. The imagery format used to exchange image information between system components is the standard National Imagery Transmission Format Standard (NITFS 2.1). The data and control interfaces are handled via copper and fiber-based gigabit Ethernet. For sensor systems that currently do not output standard NITFS imagery in Ethernet packets, the Sensor Link Interface Chassis (SLIC) converts the sensor-specific formats into the NCMIFTI standard format. Figure 6 outlines the net-centric architecture for the avionics and airborne control and display stations. This architecture allows for control and screening of the airborne NCMIFTI sensors and processors via the onboard CADS systems and/or from distributed networked CADS systems that may be remotely located.

Figure 5 Image
FIGURE 5
Netcentric open system control and display station architecture.
Figure 6 Image
FIGURE 6
August 03 P-3 EO/IR and HSI Payloads-Multi-INT fusion processing for real-time target detection.

Initial P-3 Implementation and Real-time Flight Demonstration: The initial configuration of the NCMIFTI system was demonstrated during P-3 flights over Montana and Georgia in July-August 2003 that exercised the real-time fusion targeting and netcentric dissemination capabilities. The demonstrated sensor suite for these flights included a high-resolution dual-band EO/IR camera similar to the F/A-18 SHARP sensor and two HSI sensors (VNIR and SWIR) (Fig. 6). CDL carried compressed sensor data to the ground. CADS systems at several ground sites (Fort Benning, Georgia; SPAWAR, Charleston, South Carolina, and NRL-DC) (Fig. 7) were interconnected via the Defense Research and Educational Network (DREN) to demonstrate real-time netcentric image screening, exploitation, and dissemination. In addition to the facilities that were outfitted with NRL CADS systems, several other sites (e.g. DISA) were secondary recipients of fused targeting products via classified networks. Figure 8 shows the CADS waterfall and situational awareness screens implemented for simultaneous reception and exploitation of the EO/IR and VNIR HSI imagery transmitted from the P-3 and networked to the various distributed exploitation locations. Also shown are fused targeting products, with the HSI detection cues, from two of the P-3s targeting missions (i.e., camouflaged Cessna aircraft and tagged convoy detection).

Figure 7 Image
FIGURE 7
Netcentric ground station interconnectivity.

Figure 8 Image
FIGURE 8
Real-time fusion target detection and exploitation.

Summary and Acknowledgments: The initial flight demonstrations of the NCMIFTI project have shown great promise for real-time airborne multi-INT fusion target detection, exploitation, and dissemination. Significant support for these demonstrations was provided by NRL's Center for Computational Science (networking, DREN connectivity), the Space Dynamics Laboratory (CADS, SLIC joint development), the NRL Flight Support Detachment, Smart Logic, Inc., and Platform Systems, Inc. Future NCMIFTI flight demonstrations with long-range oblique HSI, ELINT, and SAR sensors are planned for 2004.

[Sponsored by OSD]