What does multimodal mean?
Multimodal describes something that combines two or more distinct modes of communication, presentation, or input. These may include language, images, sound, video, gesture, or other sensory forms. The word is especially common in discussions of artificial intelligence, where a multimodal model can interpret and combine information from sources such as typed text, speech, photographs, and video. It is also used in design and media studies for experiences that integrate several forms of communication. In everyday contexts, multimodal may describe a presentation combining speech, slides, music, and images, or an interface that accepts commands through more than one channel. Unlike the broader term multimedia, multimodal often highlights how different modes work together rather than merely indicating that several media types are present. The word is formal but well established in technical and academic vocabulary.
adjectiveInvolving or combining two or more modes, such as text, images, audio, video, or sensory input. In technology, it describes systems or applications that process or present information in more than one form.
- Involving the combination of two or more modes of communication, presentation, or sensory experience.
- Describing a computer system or model that can process information presented in multiple formats, such as text, images, audio, or video.
"The company developed a multimodal assistant capable of answering questions from both text and spoken prompts."
"Researchers presented a multimodal system that analysed both the spoken question and the accompanying image."
"The exhibition offered a multimodal experience combining narration, music, and interactive projections."
Multimodal systems can understand a request whether it arrives as speech, text, an image, or a combination of all three.
Reviewed by Deb Chak, Editor. AI-assisted content curated by RJS Tech Solutions LLP.
Where does multimodal come from?
Multimodal was formed in English from the combining form "multi-", meaning "many," and "modal," meaning "relating to a mode." Modal ultimately comes through French from Latin modalis, a derivative of modus, meaning "measure," "manner," or "way." Related English words include mode, modify, modest, and commodity, all of which reflect the same Latin root.
Related word forms
How multimodal is actually used
The term is especially common in computing, artificial intelligence, design, and media studies. It is usually more technical than "multimedia" and specifically emphasizes integration or simultaneous use of different modes.
Easily confused with multimodal
Multimedia refers broadly to content that combines media such as text, images, audio, and video, whereas multimodal more often describes the integration or processing of multiple input or communication modes.