About Mantis
Image capture and video-based applications have come a long way in the past decade. Image quality has made major leaps with the transition from HDTV to 4k ultra HD (and beyond), the introduction of high dynamic range, and the broadening of the spectral range. The purpose of this project is to further improve image capture systems for high-end security and broadcast, while lowering cost and opening the path for new functionality and ease of use. The core of MANTIS vision is the development of a multi-modal, multi µ-camera system connected to an artificial intelligence (AI) capable edge processing box.
Combining information from multiple wavelength spectrum leads to better contrast and detectability as shown in figure
In terms of utilization:
- For high-end security systems, the project will deliver new solutions that allow users to see more, farther and longer at the same size, weight, power, and cost, without increasing the complexity for the end user.
- For broadcast, project results will help content creators for live television productions support the evolution of mobile technology to transform the way people around the world consume media content.
Object detection and tracking: The pipeline developed by TNO processes a video real-time with a deep learning detector designed to detect and track small objects. The field of view is split into tiles which are processed in batches by the deep learning network running on the GPU.
Venue: Eindhoven University of Technology (TU/e), in the Netherlands