FFglitch, FFmpeg fork for glitch art

328 pointsposted 3 days ago
by captain_bender
(ffglitch.org)

44 Comments

dylan604

3 days ago

I love how we try to recreate things that are errors to add realism to something too clean. I've spent many hours in front of tape machines from analog to digital, and each format has its peculiarities when glitching. The analog formats had drop outs and other noise from the analog nature as well as things like head switching. There were also the various methods of drop out compensation like BCSP that would repeat the last good line which could lead to some interesting "smearing". Then there are other things that get imitated like when a monitor would lose sync and you'd see the horizontal/vertical blanking rolling through the screen or lose one of or swap the UV channels. The digital tape formats that had DCT blocks started displaying what this glitch art is inspired by (for lack of better phrasing). So for someone this "inside baseball", it would be a problem when these issues happened so it takes a second to get over the initial "oh no that needs to be fixed" to "that looks cool!"

v9v

3 days ago

"Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit - all of these will be cherished and emulated as soon as they can be avoided. It’s the sound of failure: so much modern art is the sound of things going out of control, of a medium pushing to its limits and breaking apart. The distorted guitar sound is the sound of something too loud for the medium supposed to carry it. The blues singer with the cracked voice is the sound of an emotional cry too powerful for the throat that releases it. The excitement of grainy film, of bleached-out black and white, is the excitement of witnessing events too momentous for the medium assigned to record them." -Brian Eno

xattt

2 days ago

My HAM radio instructor (VE3XT) was a transmitter engineer who lamented the resurgence of tube amps in the 2000s. He said that what young people call “warmth” in sound is distortion that his kinfolk worked tirelessly to eliminate.

I didn’t understand it at first, and then I saw the growing interest in compact cassettes and was metaphorically tearing out my hair.

diggan

2 days ago

> Whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature

Exactly how I feel about AI art today, and doesn't make me super hopeful for the future. Hopefully there been cases where that hasn't been true?

But then I remember seeing datamoshing as weird the first times I saw it used as a transition in the "Off the Air" TV series/anthology, nowadays I think it makes me fuzzy and almost nostalgic instead?

hapidjus

2 days ago

Looking forward to cherishing “You are absolutely correct, let me fix that…”

dvfjsdhgfv

2 days ago

> CD distortion

Care to elaborate on that?

v9v

2 days ago

It's a quote, so I can only speculate. Maybe he was referring to the effects caused by scratching or other damage on the disk?

FirmwareBurner

2 days ago

> CD distortion

WHAT?!

Maybe you mean the dynamic range clipping caused from the bad mastering that happened during the loudness wars, but CD as a medium is impossible to have audio distortion due to its impressive 44.1 kHz sample rate at 16 bit depth.

privatelypublic

2 days ago

You speak of "The Loudness Wars." It was a fully intentional choice made by people who knew exactly what they were doing. For the most part, bowing down to label pressure to let people think their stereo is louder.

Except for the guy who did Red Hot Chili Peppers' albums. He was known for compressing sound, and turned it to 12 for the loudness wars. Californication is the poster-child of the issue for a reason.

FirmwareBurner

2 days ago

How does that contradict what I said?

wahnfrieden

2 days ago

It doesn’t. Conversation isn’t debate

FirmwareBurner

2 days ago

Right, my bad I misunderstood.

privatelypublic

2 days ago

No offense taken here. Maybe my tone was confrontational without reason.

MitPitt

3 days ago

Awesome! I remember seeing Datamosh 2 plugin for After Effects, but didn't know it used this open source project. Turns out there is a whole bunch of GUIs for ffglitch: https://ffglitch.org/frontends/

jedbrooke

3 days ago

there used to be a running joke in the AfterEffects subreddit that 95% of “What’s this effect called?” questions the answer was datamoshing. I think they even had a bot that would auto answer with datamoshing since it was asked so frequently.

tentacleuno

3 days ago

This page doesn't explain what FFglitch does, or how it's different to ffmpeg. For instance, what's Glitch? I'm guessing it's an architecture, but the post doesn't explain what it is or contextualize the term "architecture."

bawolff

3 days ago

From what i understand "glitch art" is using compression artifacts and encoding errors as art.

Presumably ffglitch is ffmpeg with code to fudge the file checksums so that encoding errors are allowed to accumulate instead of triggering an error.

mamonoleechi

3 days ago

>https://en.wikipedia.org/wiki/Glitch

>Television glitch --> In broadcasting, a corrupted signal may glitch in the form of jagged lines on the screen, misplaced squares, static looking effects, freezing problems, or inverted colors. The glitches may affect the video and/or audio (usually audio dropout) or the transmission. These glitches may be caused by a variety of issues, interference from portable electronics or microwaves, damaged cables at the broadcasting center, or weather.

On computers, those happens when some of the data (video, audio, image) is corrupted or lost.

Glitch art: some of those glitches create cool effects that you can see a sort of photoshop filter ; ffglitch helps you corrupt files/create those effect for artistic purpose.

You can see cool examples of glitch video art there: https://ffglitch.org/gallery/ ; they show the original clip, and then the glitched version

---

You can also have corrupted sounds, you can check 'The Glitch Mob' which is an group creating music, with samples that sounds corrupted.

nom

2 days ago

It's ffmpeg but takes a script as an argument which gives you access to the low level structures of the encoded video stream.

For example you can change the values of the motion vector in each frame.

That way it always generates valid video files.

fishgoesblub

3 days ago

The clearly labeled "What?" button at the top of the page explains everything.

hiccuphippo

3 days ago

The what button doesn't explain much.

As far as I know, "glitching" is opening a jpeg file with a text editor then deleting random ranges of characters, saving it again and then letting image viewers try to open the file, resulting in artifacts being added to the image.

This project seems to do the same for video files, but generating a valid video at the end.

shit_game

3 days ago

The best way I've come to describe glitch art in my papers or talks with peers is that a "glitch" in the context of glitch art is the deliberate abuse of a format of media, taking advantage of either noise, compression schemes, or undefined behavior to produce media that would otherwise not exist (due to contraints of, say, a compression algorithm and a binary format like JPEG), or to reproduce media that is discarded by these (and other) mechanisms of the format (The Ghost in the MP3[0] is a fantastic, and arguably the pioneering work in this regard).

Formats such as circuitbending are alien to me, as I primarily work with digital and occasionally analog photos and videos, but generally follow the same principles of breaking away from intended use of some set of rules to express illegal states.

0. https://www.theghostinthemp3.com/theghostinthemp3.html

thenthenthen

3 days ago

That is “data bending” (borrowed from “circuit bending”; e.g. opening a toy that makes sound and using ‘a moist finger’ probing the pcb for changes in sound). Glitching is the intentional act of introducing errors in hardware or software, to expose the inner workings (in the case of Glitch art, this was the original aim, to expose ‘the ghost in the machine’). Rosa Menkman wrote extensively about Glitch Art here: https://beyondresolution.info/Glitch-Studies-Manifesto

BoardsOfCanada

3 days ago

At university we implemented a DCT+quantization encoder/decoder for audio, and had a buggy version produce these super alien, beautiful sounds. I've often wished I had saved that version.

drmpeg

2 days ago

Here's some "glitch art" made with an SDR transmitter output power set to exactly the SNR threshold of the receiver.

https://www.w6rz.net/pixellation.mp4

colechristensen

2 days ago

One of the projects I've had in mind for a while is implementing a transmitter and receiver pair in GNURadio and adding in noise or otherwise abusing the signal for glitch purposes

chakintosh

2 days ago

Kanye West's "Welcome to Heartbreak" Is imo one of the best uses of this effect

bawolff

3 days ago

You know, i was all ready to be dismissive of this, using encoder errors for art sounds silly.

But i watched the video and it really was cool and artistic.

shit_game

3 days ago

Plenty of incredible works of art and story telling use glitch art to evoke feelings and notions of "brokenness" or surreality. Some pieces that come to mind are Adventure Time S5E15: A Glitch is a Glitch, created by artist David OReilly[0] and the music video for A$AP Mob - Yamborghini High made by editor Uncle Luc[1].

This of course doesnt even begin to touch on the influences glitch art has had on music and audio - it's arguable that glitch art has its origins in printing, photography/film, and in electronic music, but most deliberate uses of "glitches" as artistic vehicles tended to arise during the early eras of electronic music production. Rosa Menkman speaks in depth about the origins of glitch art in the music scene in her paper The Glitch Moment(um)[2].

0. https://rhizome.org/editorial/2013/apr/25/datamoshing-land-o...

1. https://www.youtube.com/watch?v=tt7gP_IW-1w

2. https://mediarep.org/server/api/core/bitstreams/b16c898a-c6b...

epiccoleman

3 days ago

The quintessential example of glitch art, imo, is Adult Swim's Off the Air, which compiles various short animations and music cut together with various datamoshed transitions. While the glitch stuff isn't always the central focus it definitely goes a long way towards setting the trippy vibe they're going for.

There are too many excellent episodes to list but Animals is a great one to get a feel: https://youtu.be/59QBOO6m210

And the Dan Deacon USA special episode might be peak Off The Air:

https://youtu.be/9X4fYP9bqqw

antegamisou

2 days ago

Yeah and while I can relate to your first sentiment, it's still infinitely better than some AI slop like this generative music shit that is currently at the top of the frontpage.

maxglute

3 days ago

Nice, watching too much datamosh / glitch art makes my brain tetris effect glitches in my dreams.

pkdpic

3 days ago

this is beautiful, the video with the two guys in the urban landscape was especially inspiring, looking forward to experimenting with this someday

jedbrooke

3 days ago

cool art! seeing datamoshing like this always impresses me at how much motion is encoded in modern video codecs

Hamuko

3 days ago

Didn't we already have VLC for this?

mkl

3 days ago

Glitch art, not glitch arch. The main page https://ffglitch.org/ is a slightly better introduction to the project.

tomhow

3 days ago

Updated, thanks!