Sustainability & AI

Multimodal AI

AI models that work across text, images, audio and other data types, enabling richer environmental monitoring and analysis.

Established · Editorial draft · Last reviewed 21 Aug 2026

Definition

AI models that process and relate multiple types of data — text, images, audio, video, sensor streams — within a single system.

Quick reference

At a glance

Subject
Sustainability & AI
Editorial status
Editorial draft
Definition status
Established
Last updated
21 August 2026

References

ICML 2021 / arXivRadford et al. — Learning Transferable Visual Models From Natural Language Supervision

This source provides part of the technical or institutional basis for the definition.

ESAΦ-lab — AI for Earth observation innovation lab

This source supports the explanation of how the term is applied, measured or governed in practice.

Overview

What it means

Multimodal models learn shared representations across data types; OpenAI's CLIP (2021), which jointly embeds images and text, was a landmark. The approach allows a model to answer questions about an image, caption a chart, or cross-reference a report with satellite evidence.

How it is used

Sustainability applications exploit complementary evidence: combining field photographs with acoustic records and satellite scenes for biodiversity assessment, or cross-checking textual claims against imagery in supply-chain due diligence.

Why it matters

Environmental reality is multimodal — it is seen, heard, measured and described. Models that integrate these channels enable richer monitoring, but also make it harder to trace which evidence drove a conclusion.

Review

Help keep this definition useful and accurate.

0
No editor-accepted reviews yet

Submitted reviews stay private until an editor decides whether to accept and attribute them.

Endorse this definition

Confirm what works

Endorse the current wording when it is accurate and useful. Suggested changes use the separate editorial form below.

Have evidence, context, or a correction to share? Every suggestion is considered by an editor before publication.

Classification
Established
Review stage
Editorial draft
What the classifications mean

This term is classified as Established

EstablishedCurrentMultiple definitionsContestedEmergingIndexed