MANTIS Vision

iMAgiNg Technologies of Industry and Security vision

About Mantis

Image capture and video-based applications have come a long way in the past decade. Image quality has made major leaps with the transition from HDTV to 4k ultra HD (and beyond), the introduction of high dynamic range, and the broadening of the spectral range. The purpose of this project is to further improve image capture systems for high-end security and broadcast, while lowering cost and opening the path for new functionality and ease of use. The core of MANTIS vision is the development of a multi-modal, multi µ-camera system connected to an artificial intelligence (AI) capable edge processing box. To this extent:

  • A new µ-camera architecture will be designed supporting single- and dual mode capture: combining visual with either Near Infra Red (NIR) or Long Wave Infra Red (LWIR).
  • The edge processing box will support existing image processing pipelines for cost-effective use cases. It will also include new deep learning (DL) based, real-time algorithms for new applications like DL-based image fusion, and real-time free view point rendering and 3D reconstruction.
  • For the system, new image sensors will be developed for NIR, LWIR, and the visible spectrum to further improve image quality, and to research integration of intelligence on the image sensor.

The above described system will support surveillance applications (high-end security, personal vision systems) and live television productions, both part of digital life (SRIA2021, Key Application Area). In terms of utilization:

  • For high-end security systems, the project will deliver new solutions that allow users to see more, farther and longer at the same size, weight, power, and cost, without increasing the complexity for the end user.
  • For broadcast, project results will help content creators for live television productions support the evolution of mobile technology to transform the way people around the world consume media content. Project results will furthermore help drive the expansion in overall media consumption. The new micro camera system that will be developed will broaden the product portfolios and enable the path into new AI applications like bird flight views in a stadium environment.

The partners will cooperate both in the development of Systems and Components. In Systems, partners (Adimec, TNO and Grass Valley) will work together to develop the new multi µ-camera architecture connected to the edge processing box running image processing. Camera system design will be supported using image-based simulation. Further, all partners will collaborate on multi sensor information processing. Some partners (Adimec, IDEAS, AMS, TNO and Grass Valley) will collaborate to evaluate multi-camera solutions in the LWIR, NIR and visible range for surveillance applications. Image Sensor Components will be developed and improved by AMS, Grass Valley, Delft Technical University and IDEAS. Developments will cover new image sensors for visual, NIR and LWIR.


OUR CONSORTIUM

AMS

Tobelbader Strasse 30, 8141 Premstaetten, Austria

Tel: +43 (0) 313 650 0-0

https://ams.com

ADIMEC

Luchthavenweg 91, 5657 EA Eindhoven, The Netherlands

Tel: +31 (0) 402 353 900

https://www.adimec.com

TUDELFT

PO Box 5, 2600 AA Delft, The Netherlands

Tel: +31 (0) 152 789 111

https://www.tudelft.nl


TNO

Oude Waalsdorperweg 63, 2597 AK, The Hague

Tel: +31 (0) 888 663 089

https://www.tno.nl

GRASS VALEY

Grass Valley Nederland B.V., Bergschot 69, 4817 PA Breda, Netherlands

Tel: +31 (0) 763 032 100

https://www.grassvalley.com

IDEAS

Integrated Detector Electronics AS, Gjerdrums vei 19, NO-0484 Oslo, Norway

Tel: +47 (0) 678 271 71

https://ideas.no


Supported by:

PENTA

44 rue Cambronne, 75015 Paris, France

T. +33 1 40 64 45 60

https://penta-eureka.eu

EURIPIDES

44 rue Cambronne, 75015 Paris, France

T. +33 1 40 64 45 60

https://euripides-eureka.eu

Publications

Internal link for consortium members to register publications.


News & Events


Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp

Y1-EYR

7th PCM, March 8th & 9th, 2023

Kick-off dinner at Antwerp before the 7th Project Consortium Meeting (PCM) at AMS, Antwerp

Y1-EYR

Progress Meeting - January 23, 2023

On 23rd January 2023, TNO and Grass Valley met in Breda to discuss the progress on deep learning depth map generation and align future activities in both the Mantis Vision and Imagination project

Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!

Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!

Y1-EYR

year-1 EYR, May 19, 2022

Year 1, End Year Review of the Mantis Vision project. All partners assembled and ended the day with a determination to carry on the activities for year 2 with increased vigour and mutual co-operation!


Present & Past Vacancies

Opening at EI for PhD student
Advanced near-infrared technology for 3D image sensors
Closed - more info

Opening at EI for Postdoc
Advanced near-infrared technology for 3D image sensors
Closed - more info

Previous Next

ePicture This (workshop 2023)

We are pleased to inform you that the Penta projects: Mantis Vision and Imagination will jointly organize a one-day workshop called ePicture This. This workshop will take place on Wednesday 21 June 2023 from 13:00 - 21:00, at the Delft University of Technology, in the Netherlands. This inspiring workshop will provide a unique opportunity to interact with experts in imaging technologies. We intend to bring together experts in image sensor design, image processing in the widest sense, and image capture design. Invited talks by experts in the area will be part of the programme.

Agenda

Find below the agenda for the workshop
13:00-13:10Welcome address, agenda, project overview
13:10-13:50Keynote presentation Albert Theuwissen (Harvest Imaging and Delft University of Technology): CIS STACKING TECHNOLOGY - overview and future outlook.
Image capture presentations
13:50-14:10Adi Xhakoni (ams OSRAM): A 0.5Mpixel global-shutter image sensor with NIR QE enhancement, 20mW power consumption and smart event detection modes.
14:10-14:30Dirk Meier (Integrator Detector Electronics AS): Development of a Thermal Infrared Image Sensor Module
14:30-14:50Jeroen Rotte (Grass Valley): Dark current corrections in broadcast imagers.
14:50-15:10Thierry Berthou: COLOR SHADES®: a versatile Snapshot Multispectral Imaging Technology for a wide range of applications.
Coffee break
15:40-16:20Keynote presentation by Arie den Boef (ASML)
Image Processing presentations
16:20-16:40Allan Barrea (intoPIX): JPEG XS – Lightweight compression
16:40-17:00Paulo Possa (Euresys): High Speed Interfaces for Machine Vision
Image systems tooling and interfacing presentations
17:00-17:20Dennis van Beek (Adimec): How active alignment maximizes performance of optical imaging systems.
17:20-17:40Piet Bijl (TNO): Performance characterization of advanced Electro-Optical and Infrared imaging systems
Sandwiches buffet break
18:40-19:20Keynote presentation by Judith Dijk (TNO): AI in Optronics
Image analysis presentations
19:20-19:40Boris Lenseigne, Julia Cohen (LR Technologies): Machine Learning for Computer Vision, a Case Study in Human-Machine Interaction.
19:40-20:00Ljubomir Jovanov (imec-Ghent University): Multi-sensor data fusion for VRU detection.
20:00-20:20Roland Brunner (Materials center Leoben Forschung GmbH): Advanced Image Analysis for Accelerated Material and Failure Characterization in Microelectronics.
20:20-20:30Presentation award and closing
20:30-21:15Networking drinks

If you are involved in the electronics, components and systems industry specifically on the topic of digital imaging, we invite you to participate in the workshop by registering below . The deadline for registration is 30 April 2023.

Attendance Registration

Please type in this code


We look forward to meeting you in Delft!

Participants who have been selected for presentation, please upload their full presentations below no later than 23 April 2023.
Click here to download the template & upload the full presentation.



Venue: Lecture Hall B, Faculty of Aerospace Engineering – 62, Kluyverweg 1, 2629 HS Delft
Coordinates: 51.98991644583931, 4.375318640596417

Keynotes

Albert Theuwissen: "CIS STACKING TECHNOLOGY : overview and future outlook".
Click here for the abstract.

Arie J. den Boef: "Image Sensors for optical metrology in semiconductor device manufacturing".
Click here for the abstract.

Judith Dijk: "Applying AI for EO for data driven approaches such as Deep Learning: overview of the added value and challenges".
Click here for the abstract.

For hotel recommendations, we can suggest the following:

Hotel Grand Canal
Ibis Delft City Centre
The Social Hub Delft

CONTACT us

Do you have a question related to the MANTIS project/ePICTURE THIS?
Contact us and we'll get back to you!

Share


Please type in this code