19 · Sound, voice, and music
Sound supplies information about bodies, spaces, events, and ideas, including things outside the image. Describe a sound through separate questions: what produces it in the story, how it was made for the production, whose listening experience it represents, and how it behaves in the final mix.
A recording made later can still represent a sound inside the story. An invisible source can still belong to the scene. Music can move between a source in the scene and a broader dramatic presentation. These relationships need explicit labels rather than one catch-all “background audio” field.
Speech and recorded elements
Dialogue#
Definition. Speech exchanged by people or characters within a scene, including conversation carried through devices or heard outside the frame. Dialogue describes the dramatic function, not the method used to record it.
Use. Plan intelligibility, overlap, interruption, and the relationship between words and reactions. A dialogue track may combine production recordings, alternate takes, and replacement recordings.
Example. Two coworkers discuss a missing shipment while a radio operator interrupts with a contradictory delivery time.
Production sound#
Definition. Audio recorded during the filming of a scene, including dialogue, actions, and the surrounding environment. It may be synchronized with the camera recording or captured separately during the same production setting.
Use. Identify which elements are usable, which carry valuable performance, and which need support in post-production. Preserve take and microphone information so matching remains possible.
Example. The location recording retains an actor's hesitant delivery, while an intrusive generator hum is reduced during editing.
ADR#
Definition. Automated dialogue replacement: recording dialogue after filming to replace or supplement lines, usually while matching the pictured performance. “Looping” is a common related production name. Despite “automated,” performance and synchronization require creative work.
Use. Address unusable audio or changed lines while matching timing, delivery, and acoustic perspective. ADR is not a general name for all voiceover.
Example. An actor rerecords one sentence obscured by a passing truck, matching the original breath and visible mouth movement.
Voiceover#
Definition. Speech presented as a separate vocal layer over images, rather than an unseen speaker's live contribution to the depicted exchange. It may convey narration, remembered speech, or inner reflection.
Use. Specify speaker, temporal position, knowledge, and whether characters hear the voice. Do not assume that recording speech in a booth determines its narrative category.
Example. A traveler describes an earlier misunderstanding while the image shows the journey that produced it.
Narration#
Definition. The act of presenting or organizing a story or account. In sound planning, narration usually means a voice that explains, recounts, or guides interpretation, whether spoken by a participant or an external narrator.
Use. Establish what the narrator knows, when they know it, and how trustworthy or limited their account is. Narration can accompany evidence without settling its interpretation.
Example. A researcher identifies dates over archive images, then clearly separates a personal inference from the surviving records.
Foley#
Definition. Sound performed and recorded to accompany pictured actions, often footsteps, clothing movement, and object handling. Foley is a sound-effects practice distinguished by performance to the action rather than simply selecting an existing recording.
Use. Match gesture, material, weight, and perspective while deciding which details deserve emphasis. The performed source may differ from the object depicted.
Example. A Foley performer recreates cautious footsteps and a stiff coat's movement for a character entering an empty office.
Sound effects#
Definition. Constructed or selected sonic elements representing actions, objects, environments, or imagined events beyond dialogue and music. They may come from original recordings, libraries, synthesis, processing, or combinations of these methods.
Use. Define the event and its narrative importance before choosing a recognizable or abstract sound. Separate dramatic emphasis from a claim of literal acoustic realism.
Example. A fictional scanner combines a motor click, filtered breath, and a short electronic pulse into one designed event.
Ambience#
Definition. The surrounding sonic environment that establishes a place, time, or atmosphere, often through sustained or recurring background elements. Ambience may include weather, traffic, machinery, animals, or distant human activity.
Use. Build spatial and temporal consistency while selecting details that support the scene. Ambient layers can change gradually without becoming the main event.
Example. A harbor scene contains distant engines, water against pilings, intermittent gulls, and a faint public-address system.
Room tone#
Definition. The relatively steady background sound of a particular recording space under its actual recording conditions, captured without intended dialogue or prominent action. It is not digital silence and is narrower than a complete designed ambience.
Use. Smooth dialogue edits and fill gaps without suddenly changing the acoustic bed. Match the relevant setup and listen for conspicuous repeated noises when looping.
Example. A short clean recording of an office's ventilation fills the gap between two edited interview answers.
Relationship to the story and image
Diegetic sound#
Definition. Sound presented as belonging to the world of the story: a voice, machine, instrument, or other source that exists there. The source may be visible or outside the frame.
Use. Record the represented source independently from recording method and screen visibility. A studio-created effect can represent a diegetic event just as a location recording can.
Example. A telephone rings in the next room while the camera remains on someone deciding whether to answer.
Nondiegetic sound#
Definition. Sound presented from outside the story world's immediate events, such as dramatic underscoring or an external commentary. “Non-diegetic” is an equivalent spelling; an unseen source alone does not establish this category.
Use. Specify how the sound addresses the audience and whether its status changes during the sequence. Avoid classifying every voiceover or musical passage automatically.
Example. An orchestral swell accompanies an isolated swimmer although no musical source exists in the represented location.
On-screen sound#
Definition. Sound whose represented source is visible in the current image. This label describes visibility, not whether the final recording was made during filming or added later.
Use. Check synchronization and the relationship between visible action and heard emphasis. A visible source may remain quiet in a subjective mix, so visibility does not require prominence.
Example. A teacup visibly touches a saucer and a carefully timed contact sound makes the nervous movement noticeable.
Off-screen sound#
Definition. Sound whose represented source lies outside the current frame while remaining part of the scene or story space. It can establish activity that viewers have not yet seen.
Use. Define the implied direction, distance, and source identity. Off-screen sound and nondiegetic sound answer different questions and should not be used as interchangeable labels.
Example. Keys turn in a lock behind the camera while the image stays on a person hiding a letter.
Subjective sound#
Definition. Sound organized to express a particular person's perception, attention, memory, or internal experience rather than a neutral presentation of the environment. It may alter level, clarity, space, or the selection of audible events.
Use. Identify whose experience governs the mix and how viewers recognize that shift. Subjectivity does not require every external sound to disappear.
Example. During an anxious wait, a clock grows prominent while nearby conversation becomes difficult to distinguish.
Perspective and treatment
Sound perspective#
Definition. The perceived relationship between listener and sound source, including distance, direction, obstruction, and acoustic space. Loudness contributes, but clarity, frequency balance, reverberation, and spatial placement also shape the impression.
Use. Decide whether the listening position follows the camera, a character, or a dramatic emphasis. Check transitions as sources move or shots change.
Example. A voice becomes muffled and less direct when the character speaking closes a heavy door between rooms.
Dynamic range#
Definition. The span between quieter and louder portions of an audio signal or program, with the exact measurement depending on the chosen method. It differs from simply making the whole mix louder.
Use. Plan contrast around intelligibility and the intended listening environment. Record any technical measurement separately from the creative note, since peaks and perceived loudness are not identical.
Example. A restrained interior mix leaves room for a sudden door slam to feel sharply louder.
Layering#
Definition. Combining multiple audio elements so they operate as a coordinated sound or environment. Layers can contribute separate roles such as impact, texture, scale, movement, or emotional association.
Use. Give each layer a purpose and check the result with layers muted individually. Additional tracks can obscure dialogue or blur an effect instead of strengthening it.
Example. A large gate uses a low mechanical strain, a brief latch click, and scattered metal vibrations.
Silence#
Definition. An absence or substantial reduction of expected sound. Filmic silence may retain breath or room tone; literal digital silence is only one possible implementation.
Use. State which layers disappear and which remain. The impact depends on the preceding sound and on the audience's expectation, not solely on a low level reading.
Example. Music and street ambience drop away after an unwelcome announcement, leaving only a person's uneven breathing.
Reverberation#
Definition. The dense persistence of reflected sound after its initial arrival, contributing to the impression of an acoustic space. It differs from a clearly separated echo, although the two can coexist.
Use. Match decay, early reflections, and the balance of direct and reflected sound to the intended space or subjective treatment. More reverb does not simply mean “farther away.”
Example. A short shout lingers in a stairwell after the speaker has moved out of sight.
Distortion#
Definition. An alteration of a signal's waveform that changes its sonic character, often adding roughness or additional frequency content. It can result from unwanted overload or be deliberately introduced as an effect.
Use. Identify whether the distortion represents a device, a damaged recording, or a perceptual state. Preserve intelligibility when the words or event remain necessary.
Example. A strained loudspeaker breaks up at vocal peaks while an announcement remains understandable enough to guide the crowd.
Sound bridge#
Definition. A sound connection across a picture edit, joining shots or scenes through a continuing or anticipated element. Its function concerns the relationship across the boundary rather than a particular kind of sound.
Use. Mark the visual cut separately from audio start and end points. Explain whether the bridge implies continuous space, memory, association, or a transition into another location.
Example. The rhythm of a workshop machine continues over the first image of a worker's train ride home.
Musical structures and functions
Score#
Definition. Music composed or arranged to support a film's dramatic structure, commonly heard as nondiegetic accompaniment. The term can also refer to the written musical notation, so production context matters.
Use. Describe what the music should contribute: perspective, structure, anticipation, ambiguity, or emotional emphasis. Specify where it enters, changes, and stops rather than asking only for a mood.
Example. A sparse score introduces a new harmonic layer only when a character decides to enter the abandoned building.
Source music#
Definition. Music presented as coming from a source within the story world, such as a radio, performance, or headphones. It is diegetic music whether or not that source is currently visible.
Use. Establish the source and its acoustic perspective. If the presentation expands into underscoring, describe the transition instead of forcing the entire passage into one category.
Example. A small radio plays in a kitchen, becoming muffled when the scene moves into the hallway.
Cue#
Definition. A specified musical or sound passage associated with a production moment, commonly identified by an entry point, exit point, and purpose. “Cue” can also mean the trigger instructing that passage to begin.
Use. Give the cue an identifier and describe required synchronization points without prescribing every musical detail. Distinguish temporary reference music from the intended final cue.
Example. Cue M12 begins after a nod, supports the walk outside, and ends before the next conversation.
Theme#
Definition. A recognizable musical idea capable of returning or being developed across a work. It may be melodic, harmonic, or rhythmic and need not always represent a specific character.
Use. Describe its identity and how changes in context or arrangement affect its meaning. Avoid confusing a musical theme with the film's broader thematic subject.
Example. A simple four-note idea first accompanies exploration, then returns more slowly during a return to the same place.
Leitmotif#
Definition. A recurring musical idea associated with a particular character, object, place, relationship, or concept. Its recurrence and transformation help audiences recognize connections, sometimes before those connections become visible.
Use. Define the association and decide how explicit it should become. A leitmotif can be brief and does not need to form a complete melody.
Example. A distinctive three-note figure appears whenever an absent mentor's influence affects the protagonist's decisions.
Drone#
Definition. A sustained or continually recurring tone, cluster, or relatively stable sonic texture that forms a prolonged musical foundation. A drone may evolve in timbre without becoming a sequence of distinct melodic gestures.
Use. Specify tonal stability, texture, movement, and duration. A drone can suggest stillness or pressure; the effect depends on its context and treatment.
Example. A low, slowly changing tone underlies a nighttime inspection without marking every step or cut.
Ostinato#
Definition. A repeated musical pattern, often rhythmic or melodic, maintained across a passage. Unlike a sustained drone, an ostinato usually has a recognizable sequence of attacks or notes that returns.
Use. Describe the pattern's length, instrumentation, and relationship to changing harmony or action. Repetition can create stability, insistence, or propulsion without changing tempo.
Example. A repeating five-note keyboard figure continues while additional instruments enter during an increasingly complex preparation sequence.
Sting#
Definition. A short, pointed musical or sonic accent that highlights a revelation, interruption, transition, or other moment. It is typically more concentrated than a cue supporting an extended passage.
Use. Choose its timing and intensity carefully so it directs attention without explaining more than intended. A sting can be comic, ominous, surprising, or restrained.
Example. A brief metallic chord accompanies the discovery that a supposedly empty locker contains a fresh uniform.
Musical qualities
Tempo#
Definition. The speed of a musical pulse, commonly described in beats per minute or with verbal indications. Perceived activity can change independently through note density, accents, instrumentation, or the absence of an obvious pulse.
Use. Specify the relevant beat unit and whether tempo remains stable. Do not substitute a faster tempo for a clear description of dramatic urgency.
Example. Music holds at the same tempo while shorter note values make the approach to a deadline feel busier.
Rhythm#
Definition. The organization of sound events and silences through time, including duration, accent, recurrence, and grouping. Rhythm exists in dialogue and effects as well as music and need not maintain a regular beat.
Use. Identify which layer supplies the pattern and how other layers respond. Describe a relation such as syncopation or interruption through a playable example.
Example. Uneven hammer blows gradually settle into a repeating pattern that the musical percussion later adopts.
Timbre#
Definition. The character or tone quality that helps distinguish sounds with similar pitch and loudness. Timbre develops through spectral content, attack, decay, noise, articulation, and changes across the sound's duration.
Use. Pair descriptive words with listening examples, since “warm,” “thin,” or “metallic” can mean different things to collaborators. Identify the feature that matters.
Example. The same melody played on breathy flute and muted electronic tones suggests two different qualities of intimacy.
Instrumentation#
Definition. The selection and combination of instruments or sound-producing sources used in a musical arrangement. It concerns which voices are available and how their roles are distributed.
Use. Describe register, density, articulation, and interaction alongside instrument names. A small ensemble can sound forceful, and an orchestra can play with great restraint.
Example. A cue uses low clarinet for sustained movement, plucked strings for intermittent detail, and no percussion.
Dissonance#
Definition. A relationship among pitches experienced or treated as unstable, tense, or demanding continuation within a musical context. Its character depends on tuning, register, timbre, style, and listening conventions; it is not simply a synonym for unpleasant sound.
Use. Describe the intended tension and whether it resolves, persists, or becomes familiar through repetition.
Example. Two close sustained pitches gradually separate as a character's conflicting choices become clearer.
Consonance#
Definition. A relationship among pitches experienced or treated as relatively stable or settled within a musical context. Historical and stylistic conventions influence that interpretation; consonance does not automatically imply happiness or agreement.
Use. Specify whether stability offers rest, reassurance, ritual, or unsettling emotional distance. Its dramatic effect depends on surrounding sound and images.
Example. A settled chord remains beneath an unresolved argument, making the music's composure feel detached from the people.
Musical counterpoint#
Definition. In music, the interaction of distinct melodic lines that retain some independence. In film discussion, “counterpoint” also describes music whose character contrasts with the image rather than simply reinforcing its apparent mood.
Use. State which meaning is intended. For picture–music contrast, explain the resulting perspective instead of assuming that any mismatch is meaningful.
Example. A buoyant mechanical tune accompanies monotonous assembly work, suggesting the institution's optimism rather than the workers' feelings.
Practical distinctions
| Independent question | Possible values | Example |
|---|---|---|
| Does the represented source belong to the story? | Diegetic; nondiegetic; changing; ambiguous | A radio is a story-world source even when the music was added later. |
| Is the source visible now? | On-screen; off-screen; not applicable | A doorbell is off-screen while the camera shows the listener. |
| How was the audio produced? | Production recording; ADR; Foley; library; synthesis; composition | A recreated footstep remains a story-world event. |
| Whose listening does the mix express? | Character; camera-associated position; external; shifting | Background speech fades as attention narrows to a heartbeat. |
| What is its role? | Speech; environment; action; musical structure; emphasis | A repeated machine pulse can serve both environment and rhythm. |
Story-world source, frame visibility, and recording method are separate classifications. Yale Film Analysis: Sound
ADR replaces or supplements dialogue, while voiceover describes a vocal presentation in relation to images; these labels are not interchangeable. Practical replacement work also includes matching the original voice's acoustic character. iZotope: Mixing audio for video
Visual interaction and structured fields
Listening is essential: diagrams should accompany short, level-matched playback examples rather than claim to demonstrate a sound by shape alone. These controls are proposals for a future learning tool.
| Decision | Visual interaction | Proposed fields |
|---|---|---|
| Sound identity and perspective | Scene map with selectable source and listener | Source; story relationship; visibility; listener; distance; obstruction |
| Mix contribution | Audition and mute individual timeline layers | Layer role; recording method; start/end; level; pan; treatment |
| Room tone and dialogue joins | Loop a short edit with before/after playback | Take ID; room-tone source; edit boundary; match notes |
| Musical structure | Cue strip with repeat and transformation markers | Cue ID; entry/exit; theme association; motif; repetition pattern |
| Rhythm versus tempo | Same pulse with interchangeable rhythmic patterns | Beat unit; tempo; event pattern; accents; synchronization points |
| Dynamic contrast | Waveform plus audible, level-matched comparison | Playback level; measurement method; peak; loudness; creative contrast note |
Related chapters
- Editing, transitions, and pace covers split edits and audiovisual rhythm.
- Animation, effects, and mixed techniques connects sound with constructed physical interaction.
- Documentary and nonfiction discusses narration, evidence, and attributed voices.
- References and creative constraints explains how to annotate specific sound references.
Sources and terminology notes
- Yale Film Analysis: Sound distinguishes a sound's story-world source from its visibility and recording method.
- iZotope: Mixing audio for video verifies ADR's dialogue-replacement function and matching considerations.
- iZotope: Reverbs in post-production demonstrates acoustic treatment of dialogue and other scene elements.
- Open University: Consonant and dissonant harmonies includes listening examples and notes that conventions of consonance have changed over time.
- Open Music Theory: Species counterpoint supplies the musical meaning of independent lines; the film-critical use of “counterpoint” should be distinguished from this technical sense.
These entries are practical descriptions, not delivery specifications. The examples are original hypothetical situations; any future audio demonstrations should identify their creator and recording source.