MAPPING

Video mapping is a projection technique that adapts an image in real time to the exact geometry of a volume or a building. Rather than projecting onto a flat screen, the image follows the reliefs, edges and perspectives of the surface (facade, monument, architectural structure) to reveal the volume rather than hide it. The building becomes a living support: textures, lights and movements enhance its architecture instead of being laid over it.

Dour Festival 2019

DARK ZONE

⚠

DARK ZONE ⚠

VJ Rien

A VJ is like a DJ who plays video. It is a total art form, little known, which has taken me and my partner Kevin Cloarec around the world to explore the golden rules of synesthesia. You have to guess what the DJ will play, choose videos that blend well, play them on a giant screen placed behind him, and start over every minute.

A music video that edits itself

After TV listens to a track and edits the music video while it plays. The player measures the bass, mids, highs and tempo, picks out the calm, the break and the drop, then chooses loops from their tags. On stage, the same logic runs in Resolume Arena.

loops cut and filed in my Resolume composition
951
loops with a speed and a role in the track
915
of the 4,811 files on my drive are in the composition
19 %
ffmpeg counts the shot cuts in 105 minutes of video
4 min 33 s

89 NSFW loops stay off the page. 10 play only once (one-shot) and 66 serve as masks.

Each loop carries its tags

I cut each loop, then tag it on a board: speed, role in the track, mood. The boxes arrive pre-checked, inferred from the label color in Resolume and from the duration, and I correct what is wrong. Everything else is measured automatically: movement, clarity, saturation, hue, framing.

The tag board shows one thumbnail per loop, three rows of choices and the NSFW, LOOP, ONE SHOT and MASK boxes.
The tag board shows one thumbnail per loop, three rows of choices and the NSFW, LOOP, ONE SHOT and MASK boxes.
This table sorts the 826 loops that can be shown by speed and by role. A loop can hold several roles.
Speedbreak314drop664suspension84hyper53
slow4042632854925
medium16541146187
fast257102331721

ffmpeg measures speed in shot cuts per second. A loop with no cut at all is slow, and 38% of the measured loops fall in that case. Above 0.099 cuts per second, it is fast; in between, it is medium.

Nine loops from the database

  • Metro

    Speed
    medium
    Role
    drop
    Mood
    house and techno
    Framing
    full frame
    Family
    city

    Movement 4.87 · Clarity 0.41 · Saturation 0.22 · Hue 23°

  • Strobing tunnel

    Speed
    fast
    Role
    drop
    Mood
    house and techno
    Framing
    full frame
    Family
    city

    Movement 2.46 · Clarity 0.11 · Saturation 0.60 · Hue 313°

  • Church

    Speed
    fast
    Role
    drop
    Mood
    house and techno
    Framing
    full frame, agitated
    Family
    city

    Movement 6.14 · Clarity 0.38 · Saturation 0.06 · Hue neutral

  • Sea in the rain

    Speed
    slow
    Role
    break and drop
    Mood
    techno
    Framing
    light at the top
    Family
    nature

    Movement 2.19 · Clarity 0.49 · Saturation 0.01 · Hue neutral

  • Fire in reverse

    Speed
    slow
    Role
    break and drop
    Mood
    techno
    Framing
    mass on the left
    Family
    material

    Movement 2.30 · Clarity 0.19 · Saturation 0.03 · Hue neutral

  • Abbey

    Speed
    slow
    Role
    drop
    Mood
    house and techno
    Framing
    full frame
    Family
    cinema

    Movement 1.38 · Clarity 0.27 · Saturation 0.06 · Hue 288°

  • Explosion

    Speed
    slow
    Role
    break and drop
    Mood
    house and techno
    Framing
    full frame
    Family
    material

    Movement 2.48 · Clarity 0.30 · Saturation 0.64 · Hue 32°

  • Steelworks

    Speed
    medium
    Role
    break and drop
    Mood
    house and techno
    Framing
    light at the bottom
    Family
    material

    Movement 1.89 · Clarity 0.17 · Saturation 0.38 · Hue 299°

  • Steel bridge

    Speed
    fast
    Role
    drop
    Mood
    techno
    Framing
    full frame, agitated
    Family
    cinema

    Movement 8.82 · Clarity 0.24 · Saturation 0.35 · Hue 288°

Across the 821 measured loops, the medians are: movement 2.18, clarity 0.23, saturation 0.20.

The rule, live

On a break, After TV plays a single slow loop in the style of the track. On a drop, it layers two, medium or fast, in screen mode, with a strobe. When it is calm, the current image stays. Here the draw is made among the 9 loops on the page; in After TV, among the 826.