Netflix vmaf: Perceptual video quality assessment based on multi-method fusion

23 pointsposted 13 hours ago
by tosh
(github.com)

9 Comments

anematode

11 hours ago

VMAF is super cool, although not the end-all-be-all of video quality measurement for sure. I'm currently evaluating switching over to the new v1.0 models.

The (unsolicited) slop PRs on that repository are a sight to behold, though. The same slopper posted an aggressive response to my PR: https://github.com/Netflix/vmaf/pull/1586

user

12 hours ago

[deleted]

fishgoesblub

12 hours ago

I was hoping this would be a post announcing the death of VMAF from Netflix, alas.

r3trohack3r

12 hours ago

Why?

fishgoesblub

10 hours ago

It's a flawed, and unreliable metric. Other metrics like SSIMULACRA2, CVVDP, or Butteraugli are more reliable/accurate and should be used if one cares about quality.

EA-3167

9 hours ago

At this point I've accepted that streaming is for the stuff that already doesn't look great (a lot of streaming content frankly), and for the rest there's physical media.

The difference is STARK.

shermantanktop

9 hours ago

The sensitivity to that difference is extremely varied. Customers buying TVs are attracted to ridiculously brightly colored videos, and go home to watch a murky movie with banding artifacts and say “I love my tv.” And they do.

I myself am not a golden eye, and I know some, and they can clap along to fragment boundaries during streaming.

EA-3167

8 hours ago

Yes this is all very true, and I have my own limitations of course; I don't fret over $200 cables or any of that. The truth is that for some movies for the reasons you already stated there's no difference worth noting because the problems are with the grading, lighting, or some other production issue.

In some cases though I think with a decent OLED most people would tell the difference. A movie like Sinners in UHD from physical media gives you something much closer to a good theater experience than the same movie compressed and streamed. Would I say no to watching Sinners at a friend's place through streaming? Heck no, it's a great movie regardless, but when I have a choice and the convenience... I'd pick the disc.