MANTIS Vision

iMAgiNg Technologies of Industry and Security vision

About Mantis

Image capture and video-based applications have come a long way in the past decade. Image quality has made major leaps with the transition from HDTV to 4k ultra HD (and beyond), the introduction of high dynamic range, and the broadening of the spectral range. The purpose of this project is to further improve image capture systems for high-end security and broadcast, while lowering cost and opening the path for new functionality and ease of use. The core of MANTIS vision is the development of a multi-modal, multi µ-camera system connected to an artificial intelligence (AI) capable edge processing box. To this extent:

  • A new µ-camera architecture will be designed supporting single- and dual mode capture: combining visual with either Near Infra Red (NIR) or Long Wave Infra Red (LWIR).
  • The edge processing box will support existing image processing pipelines for cost-effective use cases. It will also include new deep learning (DL) based, real-time algorithms for new applications like DL-based image fusion, and real-time free view point rendering and 3D reconstruction.
  • For the system, new image sensors will be developed for NIR, LWIR, and the visible spectrum to further improve image quality, and to research integration of intelligence on the image sensor.

The above described system will support surveillance applications (high-end security, personal vision systems) and live television productions, both part of digital life (SRIA2021, Key Application Area). In terms of utilization:

  • For high-end security systems, the project will deliver new solutions that allow users to see more, farther and longer at the same size, weight, power, and cost, without increasing the complexity for the end user.
  • For broadcast, project results will help content creators for live television productions support the evolution of mobile technology to transform the way people around the world consume media content. Project results will furthermore help drive the expansion in overall media consumption. The new micro camera system that will be developed will broaden the product portfolios and enable the path into new AI applications like bird flight views in a stadium environment.

The partners will cooperate both in the development of Systems and Components. In Systems, partners (Adimec, TNO and Grass Valley) will work together to develop the new multi µ-camera architecture connected to the edge processing box running image processing. Camera system design will be supported using image-based simulation. Further, all partners will collaborate on multi sensor information processing. Some partners (Adimec, IDEAS, AMS, TNO and Grass Valley) will collaborate to evaluate multi-camera solutions in the LWIR, NIR and visible range for surveillance applications. Image Sensor Components will be developed and improved by AMS, Grass Valley, Delft Technical University and IDEAS. Developments will cover new image sensors for visual, NIR and LWIR.


OUR CONSORTIUM





Supported by:

Publications

Internal link for consortium members to register publications.


News & Events


Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

Kick-off dinner at Antwerp before the 7th Project Consortium Meeting (PCM) at AMS, Antwerp

Y1-EYR

Progress Meeting - January 23, 2023

On 23rd January 2023, TNO and Grass Valley met in Breda to discuss the progress on deep learning depth map generation and align future activities in both the Mantis Vision and Imagination project

Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!

Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!

Y1-EYR

year-1 EYR, May 19, 2022

Year 1, End Year Review of the Mantis Vision project. All partners assembled and ended the day with a determination to carry on the activities for year 2 with increased vigour and mutual co-operation!


Present & Past Vacancies

ePicture This (workshop 2023)

We are pleased to inform you that the Penta projects: Mantis Vision and Imagination will jointly organize a one-day workshop called ePicture This. This workshop will take place on Wednesday 21 June 2023 from 13:00 - 21:00, at the Delft University of Technology, in the Netherlands. This inspiring workshop will provide a unique opportunity to interact with experts in imaging technologies. We intend to bring together experts in image sensor design, image processing in the widest sense, and image capture design. Invited talks by experts in the area will be part of the programme.

Agenda

Find below the agenda for the workshop

If you are involved in the electronics, components and systems industry specifically on the topic of digital imaging, we invite you to participate in the workshop by registering below . The deadline for registration is 30 April 2023.

Attendance Registration

Please type in this code


We look forward to meeting you in Delft!

Participants who have been selected for presentation, please upload their full presentations below no later than 23 April 2023.
Click here to download the template & upload the full presentation.



Venue: Lecture Hall B, Faculty of Aerospace Engineering – 62, Kluyverweg 1, 2629 HS Delft
Coordinates: 51.98991644583931, 4.375318640596417

Keynotes

Albert Theuwissen: "CIS STACKING TECHNOLOGY : overview and future outlook".
Click here for the abstract.

Arie J. den Boef: "Image Sensors for optical metrology in semiconductor device manufacturing".
Click here for the abstract.

Judith Dijk: "Applying AI for EO for data driven approaches such as Deep Learning: overview of the added value and challenges".
Click here for the abstract.

For hotel recommendations, we can suggest the following:

CONTACT us

Do you have a question related to the MANTIS project/ePICTURE THIS?
Contact us and we'll get back to you!


Please type in this code