LookingGlass: Generative Anamorphoses via Laplacian Pyramid Warping

129 pointsposted 7 months ago
by jw1224

35 Comments

mg

7 months ago

This reminds me a bit of a project I am currently doing where I swap adjacent pixels in the last image of short video sequences until it resembles the first image:

https://www.instagram.com/marekgibney/reel/DILksFYNSkE/

vintagedave

7 months ago

That's quite an extraordinary effect. There's a point where enough pixels have been swapped that you can see the original, and it jumps out, and thereafter the image is quite surreal before eventually being 'tinted'.

(Also shows the video compression in the final frame well, because it doesn't match the first frame. Just found that interesting.)

sandspar

7 months ago

This is really neat. The videos give me an instant headache. It's quite exciting to feel such a palpable and unusual effect from a video. Until now I wasn't aware that a video could give me a headache. I wonder what other physical sensations are possible from video? My compliment is genuine.

user

7 months ago

[deleted]

ygritte

7 months ago

It looks like this could be used for some form of steganography. You need the right mirror form for decoding.

tsumnia

7 months ago

When I saw the video I wondered how many layers of refraction you could achieve while maintaining coherent images. The pixelated style they should might be the easiest use to develop this from.

lawlessone

7 months ago

it's all pixelated. Some is just more pixelated.

serf

7 months ago

laplacian pyramid warping or just anamorphosis?

'anamorphic encryption' schemes have been used for hundreds of years.

jkhdigital

7 months ago

Can you give a specific example? The term “anamorphic encryption” was used in a paper from EUROCRYPT 2022 and I don’t see any prior formal study of the subject. A follow-up paper from PoPETS 2023 establishes that most of the widely-used cryptosystems introduced over the past few decades are indeed capable of anamorphism but nobody used the term “anamorphic encryption” until the last few years.

To say that they have been used for “hundreds” of years seems like a sweeping generalization in need of better context.

lawlessone

7 months ago

Da Vincis mirror writing? Sure it didn't use the exact word but the concept is there.

https://www.openculture.com/2017/11/why-did-leonardo-da-vinc...

jkhdigital

7 months ago

Not trying to be argumentative, but mirror writing is neither encryption nor steganography. The concept is not there.

lawlessone

7 months ago

Using the mirror to make it difficult to transcribe seems like a similar concept. Sure it's not exact phrases you'll find doing "google research"

jkhdigital

7 months ago

My PhD research is in steganography. I was familiar with those papers because I’d read them before.

fudged71

7 months ago

I love how many optical illusions have been revisited with new generative techniques

low_tech_punk

7 months ago

Are there other examples? Definitely curious to see more.

cdcox

7 months ago

Visual anagrams popped up last year using similar, though simpler methods to those in the posted. Flips, internal rotations, rearrangements, color negatives etc. [0]

Diffusion illusions did something similar at about the same time but with puzzles and multi-image color layer mixing. Some of the double puzzles they made are a lot of fun. They have great explainer videos [1] on that site including with Steve Mould.

Also there are diffusion double/hidden images using qrmonster, illusion diffusion, control net, or img2img that have been making the rounds. [2] for a random example. These work by using a fine-tuned diffusion model[3] to take an image and use it as a structuring element at various levels of following to a generated image. To see these illusions, squint or move the screen away. These are quite a bit more popular and easy to make than the other methods so many more examples show up around the internet.

[0] https://dangeng.github.io/visual_anagrams/

[1] https://diffusionillusions.com/

[2] https://www.reddit.com/r/StableDiffusion/s/nm9QMV6roD

[3] or a base model in the case of img2img

agumonkey

7 months ago

Happy to see that Disney is still as active as always in research

krick

7 months ago

Oh great. Now I suddenly feel the urge to acquire a physical oddly shaped lens or mirror.

echelon

7 months ago

Disney invited me to talk about my GenAI startup and research in front of a bunch of their execs across ABC, ESPN, Pixar, Streaming, etc. All of their folks were super nice and gracious to our small startup except for one.

Steve May basically scoffed at how little my small team could accomplish. Mind you we were using mocapped skeletal animation and object animation curves to fully steer video diffusion over a year and a half ago. Before image to video modalities. He picked apart our training and engineering and gloated that they could do better.

The incident is seared into my brain.

I can't help but think of Disney as the Empire and Pixar as the Death Star.

w_for_wumbo

7 months ago

If he was upset - it wasn't how little your team could accomplish. That would bring the feeling of admiration. It's most likely projection of their inability to deliver results.

dmos62

7 months ago

Sounds like the guy felt threatened by your business and insecure about his.

oidar

7 months ago

> gloated that they could do better.

did they? Anything good come from that meeting?

spuz

7 months ago

So the classic Silicon Valley brain rape is actually real?

user

7 months ago

[deleted]

ziofill

7 months ago

Don’t get me wrong, this is very neat. But why?

yard2010

7 months ago

For science. Many many small and unrelated breakthroughs can amount to something you wouldn't think of, just like what happened with "AI"

user

7 months ago

[deleted]