UAVs (Unmanned Aerial Vehicles) continue to play a vital role in executing a variety of mission critical ISR (Intelligence, Surveillance, and Reconnaissance) operations, most notably in the areas of target tracking and object recognition. While camera technology continues to improve, in-flight vibrational issues along the camera’s optic axis create challenges that must be addressed by system software designed to compensate for such movements.
According to a study conducted by the Center for Applied Mathematical Sciences (CAMS) within the University of Southern California, complex algorithms which incorporate adaptive spatial-temporal processing and advanced jitter estimation, compensation and stabilization are required to address sub-pixel translational stabilization (of up to 1-3 percent of a pixel), accurate rotational stabilization (three axis system – roll, pitch and yaw), scaling (with compensation for zooming), and resolution enhancement (accommodating double /triple the resolution).
Northrop Grumman Firebird
Engineered to be a persistent multiple-intelligence gathering air system, Northrop Grumman’s Firebird is a new breed of aircraft system that increases real-time data collection through simultaneous use of multiple intelligence, surveillance, reconnaissance (ISR) and communications sensor payloads on a single platform.
Designed for either manned or unmanned flight, the Firebird can be fully provisioned with as many as four High-Definition Full Motion Video (HDFMV) cameras or other sensors providing Signals Intelligence (SIGINT) plus Communications Intelligence (COMINT) capability.
The challenge of image stabilization is just one aspect of real-time image processing subsystems that require the latest high-performance platforms that feature the massively parallel computing power of GPU technology. As one of NVIDIA’s Tesla Preferred Partners Trenton has been designing platforms, such as the TCS4501 rackmount computer, to address the demanding needs of applications such as image stabilization and digital video processing.
Example using the Ikena software solution from MotionDSP
{ 0 comments… add one now }