Opportunity at Air Force Research Laboratory (AFRL)
Bio-Inspired Image Fusion
711 Human Performance Wing, RHX/Human Centered ISR Division
||Wright-Patterson AFB, OH 45433
Modern information systems produce a variety of imagery, which must be integrated and assimilated for proper use. For some time, there have been serious attempts to produce algorithms for optimal sensor fusion. The results have been uninspiring. While such algorithms are essential to autonomous multisensor robotic systems, man-in-loop systems might do well to simply optimize presentation for the human observer. Humans effortlessly and pre-attentively fuse information from many sensory subsystems (e.g., form, color, motion) as long as the presentation modes are compatible. How the human brain accomplishes this “binding” feat is controversial, but there is little doubt that the visual cortex exploits spatiotemporal correlations between the sensory subsystems to be bound together. The goal of this research is to investigate several presentation modes for multisensor imagery that would harness and exploit these powerful human abilities.
For example, humans have an astonishing ability to derive a coherent worldview based on limited correlation information. There are many examples. (1) Random dot images with hidden disparity correlations evoke a sense of depth (random dot stereopsis). (2) Orientation correlations between random dots-created by dilation or rotation of a copy pattern relative to an original-give a strong impression of radial or circular symmetry in the random dot patterns (glass patterns). (3) Point light walkers, created by encoding just a few points on the joints of otherwise invisible actors, yield an immediate sense of the identity and actions of the actors; through correlated motion, observers discriminate gender, distinguish sham weightlifting from the real exercise, and readily identify individuals locked together in dance. We believe that this inherent visual information processing capability could be exploited in biological sensor data fusion.
Vision; Sensor fusion; Data fusion;
Open to U.S. citizens
Open to Postdoctoral and Senior applicants