New imaging and analysis approaches for marine species detection and classification

Dive into a mesmerising world beneath the waves, where photos and videos reveal enigmatic processes of the ocean that would otherwise remain concealed. Marine imaging is an extraordinary tool that allows us to delve into the depths, enabling exploration and monitoring of the ocean while providing captivating visuals for compelling narratives. This versatile technology finds applications in diverse fields, including research, industry, and public engagement.

By delving into various aspects such as sensors, cameras, platforms, illumination, and advanced techniques like machine learning, marine imaging unlocks a plethora of questions about the ocean, spanning spatial and temporal scales from microscopic observations to satellite-based remote sensing and from slow-motion capture to long-term observatories.

Expanding horizons

The realm of marine imaging is constantly evolving, propelled by cutting-edge advancements such as hyperspectral imaging and deep learning. With the advent of underwater platforms equipped with camera systems, an ever-growing reservoir of big data sets is at our disposal. Furthermore, the availability of affordable camera systems for deep-sea exploration empowers more individuals to expand the boundaries of visual observation in the ocean’s depths.

iAtlantic’s contributions:

Within the scope of the iAtlantic project, we have conceptualised, implemented, deployed, and operated selected aspects of the marine imaging data workflow. Deliverable 2.4 of the project offers a comprehensive overview of the recent developments, some of which were achieved amidst the challenges of a global pandemic. It provides insights into imaging technologies, image data acquisition and processing, as well as image metadata. The report focuses on three key aspects:

Underwater Hyperspectral Imaging: Ifremer’s successful trials and demonstrations of underwater hyperspectral imaging techniques are highlighted, showcasing its potential for in-depth exploration.
Low-Cost Camera Systems: IMAR’s design and construction of an affordable camera system (the Azor Drift-Cam) takes centre stage, along with its deployment in Portuguese waters, showcasing its effectiveness for mapping marine ecosystems.
Enabling FAIR Image Data: GEOMAR’s efforts to make marine image data Findable, Accessible, Interoperable, and Reusable (FAIR) are detailed, along with the development of a robust and FAIR machine learning infrastructure. These initiatives promote standardized and efficient applications of marine imaging across scientific disciplines, research institutions, and marine sectors.

Contributions and implications

The imaging research conducted in work package 2 greatly contributes to the overarching objectives of the iAtlantic project. The drive to make marine image data FAIR and establish a FAIR machine learning environment aligns and standardizes ocean observation practices, transcending geographical boundaries and fostering collaboration among diverse stakeholders. Additionally, the publication and adoption of the low-cost camera system create opportunities for standardized data collection across the vast Atlantic Ocean. Already, this system has successfully mapped deep-sea and open-ocean ecosystems within the Azorean EEZ, contributing to assessments of ecosystem stability, vulnerability, and tipping points.

Advancing capacities and embracing innovation

The most remarkable achievement of the imaging work lies in its contribution to building and enhancing human and technological capacities. This is evident in innovative approaches such as linking underwater hyperspectral imaging with 3D reconstructions, developing cost-effective camera hardware, and operationalizing high-performance computers for at-sea applications. The standardization efforts and software development for FAIR marine image data and FAIR machine learning environments further solidify these advancements. These breakthrough technologies hold significant potential for commercialization, supporting the development of a sustainable blue economy.

Future prospects

The developments showcased in this report serve as stepping stones for future innovation. They provide valuable insights and recommendations for the implementation of new ideas and technologies that will drive the field of marine imaging forward.

Want to know more?

Download the full report
iAtlantic Deliverable 2.4: New imaging and analysis approaches for marine species detection and classification. Report by T. Schoening, C. Dominguez Carrio, T. Morato, T. Baijouk, M. Ferrera, T. Petit & A. Arnaubec (March 2023) (PDF, 5.3 MB)