Fast Fourier Transforms Part 1: Cooley-Tukey

62 pointsposted 7 hours ago
by signa11

12 Comments

srean

3 hours ago

At the root of the fast transform is the simple fact that

    ax + bx = (a+b)x
The right hand side has fewer arithmetic operations. It's about finding common factors and pushing parentheses in. Because of the inherent symmetry of the FT expression there are lots of opportunities for this optimization.

Efficient decoding of LDPC codes also use the same idea. LDPCs were quite a revolution (pun intended) in coding/information theory.

On the other hand, something completely random, few days ago I found out that Tukey (then a Prof) and Feynman (then a student) along with other students were so enamored and intrigued by flexagons that they had set up an informal committee to understand them. Unfortunately their technical report never got published because the war intervened.

Strangely, it does not find a mention in Surely You're Joking.

rigtorp

an hour ago

How is belief propagation used for decoding LDPC codes related to FFT?

ajross

22 minutes ago

> At the root of the fast transform is the simple fact that

Actually... no? That's a constant factor optimization; the second expression has 75% the operations of the first. The FFT is algorithmically faster. It's O(N·log2(N)) in the number of samples instead of O(N²).

That property doesn't come from factorization per se, but from the fact that the factorization can be applied recursively by creatively ordering the terms.

terabytest

5 hours ago

This website appears broken in a very unique way on my iOS device. Whenever I swipe to scroll, the page gets zoomed out and it zooms back in when I stop swiping, but half of the content is cut off.

bonefolder

4 hours ago

Quite funny because now I can’t access the comment box at all.

f1shy

5 hours ago

Same here. I think is intended as “feature” but extremely annoying.

sunrunner

4 hours ago

I'm struggling to imagine what the feature is intended to be. Being able to see a larger portion of the page while scrolling? This...doesn't help at all, sadly.

user

3 hours ago

[deleted]

Mikhail_K

2 hours ago

Fast Fourier transform was not invented by Cooley-Tukey, it was used by Gauss to compute trigonometric interpolation of orbits from observations.

ajross

2 hours ago

The factorization trick was reinvented several times. The algorithm that uses it to do a frequency decomposition was presented just once by named authors. This happens all the time. Freaking out about naming and attribution isn't really very informative.

Edit: as always, Wikipedia is a better source than comment pedantry: https://en.wikipedia.org/wiki/Fast_Fourier_transform#History

srean

an hour ago

True. Before Fourier did Fourier.