🎨Multimodal
Images, audio, video and vision · 30 terms
Vision and Language
6Models that look at a picture and then talk about it, in words.
An AI that can look at a photo. Then it tells you about it in words.
AI writes one short sentence that says what is in a picture.
You ask about a photo, and AI answers you in words.
AI that watches a video for you. Then it can answer questions about it.
Finding the spot in a picture that some words point to. A box marks it.
Numbers that put pictures and words in one shared space. Then they can be compared.
Image Generation
9Making new pictures, or changing old ones, from a short text prompt.
AI that makes a new picture from words you type. The words are called a prompt.
AI that makes a 3D object from a prompt or a photo. You can turn it all around.
Image Generation Controls
3Settings that steer an AI image beyond the prompt: what to leave out, which random start to use, and a guide picture for the layout.
A list of what you do not want in an AI image. It sits apart from the main prompt.
The number that sets an AI image's random start. Same seed, same settings, same image.
A way to steer an AI image with a guide picture. The guide can be an outline or a pose.
AI Image Editing
4AI tools that change a picture you already have, by restyling it, filling in parts, adding detail or cutting out the subject.
AI makes a new picture from one you give it. A few words say what to change.
AI redraws one part of a picture that you mark, and leaves the rest the same.
AI makes a small picture bigger and sharper. It guesses the fine detail.
AI that cuts the main subject out of a photo. What is behind it goes away.
Video Generation
5Making short video clips from text or a still picture, and fitting lips to new speech.
AI that makes a short video clip from words you type.
AI turns one still picture into a short video. Your picture is the first frame.
AI that gives a video a new look or setting. The motion stays the same.
AI changes a person's mouth in a video to match new speech.
A video of a digital person who looks real. It says any script you type.
Speech and Audio
10AI that listens, speaks, copies a voice, holds a spoken chat, or makes music.
AI that listens to speech and writes the words down.
Working out who spoke when in a recording. Each line gets a speaker tag.
A check that tells when someone is talking and when they stopped.
A short phrase that wakes a voice device. Then it listens for what you want.
AI that reads written words out loud in a voice that sounds real.
AI copies a person's voice from a short recording. Then it can say new words in it.
AI that puts the speech in a video into a new language. It often keeps the same voice.
AI you talk to out loud, and it answers out loud, often in one step.
An AI agent you talk to out loud. It listens, thinks and talks back.
AI that makes new music from a few words you type. Some tools can sing, too.