MANTIS Vision

iMAgiNg Technologies of Industry and Security vision

About Mantis

Image capture and video-based applications have come a long way in the past decade. Image quality has made major leaps with the transition from HDTV to 4k ultra HD (and beyond), the introduction of high dynamic range, and the broadening of the spectral range. The purpose of this project is to further improve image capture systems for high-end security and broadcast, while lowering cost and opening the path for new functionality and ease of use. The core of MANTIS vision is the development of a multi-modal, multi µ-camera system connected to an artificial intelligence (AI) capable edge processing box.

Combining information from multiple wavelength spectrum leads to better contrast and detectability as shown in figure

In terms of utilization:

  • For high-end security systems, the project will deliver new solutions that allow users to see more, farther and longer at the same size, weight, power, and cost, without increasing the complexity for the end user.
  • For broadcast, project results will help content creators for live television productions support the evolution of mobile technology to transform the way people around the world consume media content.

Object detection and tracking: The pipeline developed by TNO processes a video real-time with a deep learning detector designed to detect and track small objects. The field of view is split into tiles which are processed in batches by the deep learning network running on the GPU.

The partners will cooperate both in the development of Systems and Components. In Systems, partners (Adimec, TNO and Grass Valley) will work together to develop the new multi µ-camera architecture connected to the edge processing box running image processing. Camera system design will be supported using image-based simulation. Further, all partners will collaborate on multi sensor information processing. Some partners (Adimec, IDEAS, AMS, TNO and Grass Valley) will collaborate to evaluate multi-camera solutions in the LWIR, NIR and visible range for surveillance applications. Image Sensor Components will be developed and improved by AMS, Grass Valley, Delft Technical University and IDEAS. Developments will cover new image sensors for visual, NIR and LWIR.


OUR CONSORTIUM





Supported by:

Publications

Internal link for consortium members to register publications.

News & Events


ePicture This

9th PCM, September 6th & 7th, 2023

Kick-off dinner at Oslo before the 9th Project Consortium Meeting (PCM) at IDEAS, Oslo

ePicture This

9th PCM, September 6th & 7th, 2023

All partners assembled at IDEAS, Oslo to discuss progress and plan future activities

Visit of Grass Valley to Adimec on July 11th, 2023 to discuss de-mosaicking

July 11th, 2023

Visit of Grass Valley to Adimec on July 11th, 2023 to discuss de-mosaicking

Visit of Grass Valley to Adimec on July 11th, 2023 to discuss de-mosaicking

July 11th, 2023

Visit of Grass Valley to Adimec on July 11th, 2023 to discuss de-mosaicking

Visit of Adimec to Grass Valley on July 5th, 2023 to discuss experience sharing

July 5th, 2023

Visit of Adimec to Grass Valley on July 5th, 2023 to discuss experience sharing

Visit of Adimec to Grass Valley on July 5th, 2023 to discuss experience sharing

July 5th, 2023

Visit of Adimec to Grass Valley on July 5th, 2023 to discuss experience sharing

ePicture This

June 21th, 2023

ePicture This event organised at the Delft University of Technology on 21st June 2023 and the best presentation award was received by Dirk Meier from IDEAS

Year 2

May 11th, 2023

2023- Progress presentations during Year 2 review at TNO

Year 2

May 11th, 2023

2023- Partners presenting demonstrators to reviewers during the Year 2 review at TNO

Year 2

May 11th, 2023

2023- Partners presenting demonstrators to reviewers during the Year 2 review at TNO

Grass Valey and TNO

May 11th, 2023

Our Mantis 2nd year review team. We used a 360 camera setup to capture everyone standing in a circle. This demo setup will be used in the year 3 demonstrations (click on image for larger version).

Grass Valey and TNO

April 13th, 2023

Grass Valley and TNO met on April 13th in The Hague to discuss and align the work frame-based depth map generation with Deep Learning algorithms. Intention is to link the work in the Penta projects Mantis Vision and Imagination

Grass Valey and TNO

April 13th, 2023

Grass Valley and TNO met on April 13th in The Hague to discuss and align the work frame-based depth map generation with Deep Learning algorithms. Intention is to link the work in the Penta projects Mantis Vision and Imagination

Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp


Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp


Y1-EYR

7th PCM, March 8th & 9th, 2023

All partners assembled to discuss progress and prepare for the year end review and future activities at AMS, Antwerp


Y1-EYR

7th PCM, March 8th & 9th, 2023

Kick-off dinner at Antwerp before the 7th Project Consortium Meeting (PCM) at AMS, Antwerp



Y1-EYR

Progress Meeting - January 23, 2023

On 23rd January 2023, TNO and Grass Valley met in Breda to discuss the progress on deep learning depth map generation and align future activities in both the Mantis Vision and Imagination project

Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!



Y1-EYR

EFECS 2022, November 24 & 25

We are glad that MANTIS VISION gained attention exhibiting demonstrators at EFECS 2022!



Y1-EYR

year-1 EYR, May 19, 2022

Year 1, End Year Review of the Mantis Vision project. All partners assembled and ended the day with a determination to carry on the activities for year 2 with increased vigour and mutual co-operation!


Present & Past Vacancies

ePicture This (workshop 2023)

On Wednesday June 21, 2023, the Penta projects: Mantis Vision and Imagination organised a one-day workshop called ePicture This. The workshop took place at the Delft University of Technology, in the Netherlands. This inspiring workshop provided a unique opportunity to interact with experts in imaging technologies. We brought together about 50 experts in image sensor design, image processing in the widest sense, and image capture design. The programme included 3 keynote speeches by Judith Dijk from TNO, Arie den Boef from ASML and Albert Theuwissen form Harvest Imaging, followed by 10 technical presentations from industrial partners.

Venue: Lecture Hall B, Faculty of Aerospace Engineering – 62, Kluyverweg 1, 2629 HS Delft
Coordinates: 51.98991644583931, 4.375318640596417
ePicture This

June 21th, 2023

Organisers of the event – from left Marcel Dijkema (Adimec), Sandra K. R. (TU Delft), Klaas Jan Damstra (Grass Valley)

ePicture This

June 21th, 2023

Keynote speakers of the event – from top Prof. Albert Theuwissen (Harvest Imaging), Judith Dijk (TNO), Arie den Boef (ASML)

ePicture This

June 21th, 2023

Our Mantis partners from IDEAS, TNO and Adimec presenting at the workshop

ePicture This

June 21th, 2023

The best presentation award received by Dirk Meier from IDEAS. Our heartfelt congratulations to Dirk.

Agenda

Please find below the detailed agenda where you can also download all presentations

If you are interested to participate in the second edition of ePicture This, which will be organized in 2024, leave your details below.

Interested in ePicture This 2024?

Please type in this code



CONTACT us

Do you have a question related to the MANTIS project/ePICTURE THIS?
Contact us and we'll get back to you!


Please type in this code