Тёмный

3. Divide & Conquer: FFT 

MIT OpenCourseWare
Подписаться 5 млн
Просмотров 318 тыс.
50% 1

Опубликовано:

 

14 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 209   
@KaushikMishrakk
@KaushikMishrakk 5 лет назад
Just a tip for new viewers: Don't stop!! Continue watching the video, don't expect yourself to understand everything as you go, grab the essence of each section of the video and in the end it is all gonna make sense. If it did not you can always go back but don't quit this video. Amazing job Erik!!!
@chill6962
@chill6962 2 года назад
Thank you
@migueld2456
@migueld2456 2 года назад
This is very wise advise.
@__dekana__
@__dekana__ Год назад
Thank you
@AnthosPhotos
@AnthosPhotos 8 месяцев назад
I followed the strategy and now reading this comment. Going to advise the same
@mrisholukamba1696
@mrisholukamba1696 4 месяца назад
Thank youu, I rewatched 3 times before i actually got it. And I think i will rewatch for the 4th time to understand more on execution time complexity and some concepts which were mentioned but not explained enough
@leminhphuc10t1
@leminhphuc10t1 5 лет назад
The part about how size of X needs to be reduced by 2 when we go to X^2 is just brilliant! That explains the choice of x_k's that I saw on other ppl's implementation so well!
@junweima
@junweima 6 лет назад
Erik: "I didn't go to high school but I assume in high school you learned this..."
@rj-nj3uk
@rj-nj3uk 5 лет назад
Students:"hahahaha"
@godfather5557
@godfather5557 5 лет назад
convolution: 12:46
@m322_yt
@m322_yt 4 года назад
@@julius333333 and yet he’s such a humbling, sympathetic person
@tsunghan_yu
@tsunghan_yu 3 года назад
8:56
@hemiacetal1331
@hemiacetal1331 2 года назад
Weird flex but it hurts
@andrestifyable
@andrestifyable 5 лет назад
Am I the only one really impressed by the quality of that chalk? It never makes those high pitched sounds ... soo smooth
@hektor6766
@hektor6766 5 лет назад
It's called railroad chalk. Made with calcium sulfate (gypsum), not calcium carbonate (chalk). Softer than chalk hence bolder lines and no screech. Dustier though, so treated with a dust inhibitor, that's why the surface of the stick is yellow but it writes in white.
@matthewquinn5192
@matthewquinn5192 4 года назад
I didnt want to watch this video because i hate that sound so much, thank you for the reassurance so i can watch without fear
@vishalvibes_
@vishalvibes_ 4 года назад
Is it hagoromo?
@henrypeterson8497
@henrypeterson8497 2 года назад
@@vishalvibes_ nope
@personanongrata987
@personanongrata987 Год назад
I first encountered the FFT derivation of the DFT thirty years ago when I took a digital filters class while a graduate student at Georgia Tech, and I am as bolled-over now as I was then by this most elegant and incredibly useful algorithm. Thank you, Professor Demaine. --
@abdulelahaljeffery6234
@abdulelahaljeffery6234 7 лет назад
This is the best overview of what FFT is, brilliant teacher!
@mario7501
@mario7501 3 года назад
Amazing to see that such a brilliant guy can also be a brilliant educator. From my experience this is pretty rare!
@netoskin
@netoskin 2 месяца назад
This is the best explanation of the FFT you can find very intuitive and step by step. Most people explain the FFT with a matrix of coefficients and I just never understood it until I saw this more algorithm oriented explanation
@henrytay1706
@henrytay1706 2 года назад
Professor makes his lecture seems the learning material is so easy! Thank you!
@skyzhangty1
@skyzhangty1 3 года назад
This is THE BEST FFT lecture ever. Erik is simply awesome!
@TW0T0NGUE
@TW0T0NGUE 7 лет назад
Not going to lie, I cam here to learn the FFT as an engineering student, but stuck around to learn about this CS time complexity.
@tennma6250
@tennma6250 4 года назад
same here haha
@woosix7735
@woosix7735 Год назад
Kinda the whole point of the fft
@yashjakhotiya5808
@yashjakhotiya5808 5 лет назад
27:46, we can use Lagrange's Formula to compute Coefficients from Samples. It is O(n^2) but avoids inverse computation by Gaussian Elimination.
@tibortresla
@tibortresla 8 лет назад
These tattoo jokes tho. BRILLIANT!
@mavenuparker
@mavenuparker 7 лет назад
Didn't know that Jin from SamuraI Champloo now teaches at MIT. Thanks for the amazing overview of FFT. Amazing lecture
@SR-kp8zu
@SR-kp8zu 4 года назад
lmaooo did not expect to see a samurai champloo reference while learning about the FFT
@sanatanshrivastava1725
@sanatanshrivastava1725 2 года назад
As he puts it, this all was "very cool, very cool". Thanks, Erik.
@vamsimohan5369
@vamsimohan5369 3 года назад
Throughout the whole video i could not stop wondering about him(he is a child prodigy, became a professor at MIT at 20 )
@suicide_king6804
@suicide_king6804 6 лет назад
Having barely mastered some basic arithmetic, this may be a little advanced...even though I have no idea wtf this guy is talking about/drawing, it is fascinating to try and understand it.
@BenjaminKorenBJK
@BenjaminKorenBJK 5 лет назад
@@aristosgeorgiou6060 yeah, very relatable, lol
@karanveersingh5535
@karanveersingh5535 2 года назад
@@aristosgeorgiou6060 lol 🤣
@saicharanmarrivada5077
@saicharanmarrivada5077 2 года назад
@@aristosgeorgiou6060lol😂
@muhammedafifi6388
@muhammedafifi6388 6 лет назад
I don't know how I used to call myself an engineer before watching this video!
@nalcow
@nalcow Год назад
Its always a pleasure to listen Eric's lecture. Great professor.
@sa6opopov
@sa6opopov 8 месяцев назад
This is the most beautiful algorithm I have seen
@DominicLondon
@DominicLondon 6 лет назад
Beware of the plot τwist.
@vishalvibes_
@vishalvibes_ 4 года назад
Hidden spoilers
@randomperson1048
@randomperson1048 4 года назад
Real men cried at the end when he brought up those applications. Truly beautiful mathematics
@akshaydarekar5863
@akshaydarekar5863 5 лет назад
My Brain Stack starts overflowing after 35:00.
@chethankumar4303
@chethankumar4303 6 лет назад
Gave an in depth understanding of FFT...Brilliant Explanation
@jayhoeliotdecabrio4050
@jayhoeliotdecabrio4050 3 года назад
Erik: "I didn't go to high school but I assume in high school you learned this..." reminds me seldon cooper
@khoily9137
@khoily9137 6 лет назад
High pass filter removes low frequency, and low pass filter removes high frequency
@xinli6243
@xinli6243 5 лет назад
yeah, I caught this as well.
@aSeaofTroubles
@aSeaofTroubles 8 лет назад
One of the best lectures I've seen :) really brings out the true nature of the DFT
@szyszkienty
@szyszkienty 3 года назад
This guy oozes brilliance! Amazing lecture!
@madhukiranattivilli2321
@madhukiranattivilli2321 2 года назад
Implemented FFT algo for both polynomial multiplication and integer multiplication Deadly algo :) % java FFTPolynomialMultiplication i/p polynomial A : 2 + 3x + xˆ2 i/p polynomial B : 1 + 2xˆ2 n (=2ˆk) = 8 o/p polynomial C : 2 + 3x + 5xˆ2 + 6xˆ3 + 2xˆ4 % java FFTPolynomialMultiplication i/p polynomial A : 8 + 7xˆ2 + 3xˆ3 + 9xˆ5 i/p polynomial B : 4 + 5x + 6xˆ2 + 7xˆ3 + 8xˆ4 n (=2ˆk) = 16 o/p polynomial C : 32 + 40x + 76xˆ2 + 103xˆ3 + 121xˆ4 + 103xˆ5 + 122xˆ6 + 78xˆ7 + 63xˆ8 + 72xˆ9 % java FFTIntegerMultiplication i/p integers : A = 123,456,789 B = 956,227,496 n = 32 product = 118,052,776,209,670,344 % java FFTIntegerMultiplication i/p integers : A = 2,147,483,647 B = 2,147,483,647 n = 32 product = 4,611,686,014,132,420,609
@RandomGuy12562
@RandomGuy12562 8 лет назад
is there a mistake @28:35 ? we know V.A = Y ( V - vandermond matrix, A - coefficien matrix, Y - samples matrix) (multiplying by V inverse i.e. V^(-1) both sides) => V^(-1).V.A = V^(-1).Y => A = V^(-1).Y So to go from samples matrix to coefficient matrix we need to do V^(-1).Y right ??
@donxu1332
@donxu1332 8 лет назад
you are right. it is a mistake
@danielf9110
@danielf9110 7 лет назад
I think you are correct
@AdamCajf
@AdamCajf 6 лет назад
Yes, this should be V^{-1} Y
@nayuki2020
@nayuki2020 4 месяца назад
around 1:20:00, you can't get pure sine wave from striking a bell. Bell, or piano, or a person singing the same note each has a unique timbre to it. Use an online sine wave generator and listen to what a pure tone sounds like (at a certain frequency). Sing that out feel the difference, and view it under a frequency analyzer, they will look vastly different.
@martinstefcek4089
@martinstefcek4089 6 лет назад
The root representation should be (x-r1)...(x-r(n-1)) not from (x-r0), you can easily see that if you do it from r0, then you will have polynomial of x^n (which is one degree higher than what he used in the first rep.)
@sophiophile
@sophiophile 3 года назад
He did this because he claimed you need n points to represent an n-1 polynomial. If you watch later into the video, he wrote it in this weird way cuz he was centring things around the number of points you need, not the number of coefficients represent the polynomial.
@noguide
@noguide 6 лет назад
*Stands up & claps* Eric, take a bow. This should be the reference for any instructor of how to explain the FFT.
@programmingbro2424
@programmingbro2424 3 года назад
this lecture is freaking amazing
@diofeher
@diofeher 19 дней назад
Brilliant teacher!
@TheBoutchard
@TheBoutchard 4 года назад
Me: Has a school assignment where I have to implements an algorithm dividing two polynomials and I have no idea what to do This man: I'm about to save this man whole career
@bhaskarpandey8586
@bhaskarpandey8586 3 года назад
Modify euclidean algorithm for gcd
5 лет назад
how to be a frisbee player join as MIT lecturer
@rohankhandelwal7681
@rohankhandelwal7681 5 лет назад
i was present in this class
@Deshammanideep
@Deshammanideep 4 года назад
That's a great thing. What are you doing now brother...?
@vetiarvind
@vetiarvind 4 года назад
Wow you went to mit? How did you apply, from India or USA?
@hektor6766
@hektor6766 5 лет назад
I was just thinking earlier today about root 2/2 being the sine and cosine of 45 degrees, e^(2)i pi (e^i tau) and how they related to the unit square and circle. Fourier, Gauss, Dirichlet all stood on Euler's shoulders.
@englishmotherfucker1058
@englishmotherfucker1058 4 года назад
it always comes back to euler like it's rome all roads, somewhere, somehow, all lead to euler
@leeris19
@leeris19 5 месяцев назад
COOL! The only thing I don't prefer ( for lack of nicer word ) is the fact that he used a claim for last proof (IFFT). The problem with claims is that they are the result of some careful thinking, we're just proving that that thinking is correct. It would have been beautiful if he showed us the steps that resulted in the inverse of V being a n * V conjugate so we can fully sympathize for I believe sympathizing is the best way to learn math
@MaxMarrone
@MaxMarrone 5 лет назад
Okay, we've figured out how to convert between different representations of polynomials, but how do we go from there to the familiar application of the FFT - converting between the time domain and frequency domain? Given a bunch of samples, we want a weighted sum of sinusoids, but what we get here is the coefficients of a polynomial.
@sophiophile
@sophiophile 3 года назад
This question has been plaguing me for a while. Did you ever discover an answer to this.
@THeMin1000
@THeMin1000 3 года назад
@@sophiophilethe coefficients that we get IS the FT, instead of the points being the coefficients of the polynomial representing the time domain function we get the samples from the polynomial representing the polynomial in frequency domain.
@domenicozaza192
@domenicozaza192 2 года назад
The tatoo gag is amazing!
@vivekdabholkar5965
@vivekdabholkar5965 Год назад
Nice lecture! I thought MIT classes would be very hard.
@BTDiLmarinen
@BTDiLmarinen Год назад
MIT isn't a place for geniuses, it's just a normal university that only accepts students that can apply themselves.
@abugigi
@abugigi Год назад
Erik is Demaine man!
@prateeksamaiya
@prateeksamaiya 6 лет назад
the product of two n-1 degree polynomial will be 2n-2 and we need 2n-1 unique points to derive a 2n-2 degree polynomial and nth root of 1 gives just n points and not 2n So My question is dont we need 2n points intead of n?
@_rashadmammadov_
@_rashadmammadov_ 6 лет назад
It's already been noted that two polynomials should be reduced to the same degree and up to the nearest power of 2 (simply by adding the coefficients with zeros). In addition, as a result of the product of two polynomials of degree (n - 1) a polynomial of degree (2n - 2) is obtained; therefore, in order for the result to be correct, it is necessary to double the degrees of each polynomial (again by adding zero coefficients to them)
@ZuvielDrama
@ZuvielDrama 3 года назад
This was hard. Hope i will understand it soon.
@nikhil_kolla_12
@nikhil_kolla_12 5 лет назад
Excellent explanation.
@paragggoyal1552
@paragggoyal1552 Год назад
at last, absolute detail!
@saltcheese
@saltcheese 5 лет назад
if there is a god, MIT is doing her work
@not_melkor
@not_melkor 3 года назад
This is what reaching GOD Level feels like in teaching?
@Kaslor1000
@Kaslor1000 5 лет назад
Phenomenal lecture.
@c0t556
@c0t556 5 лет назад
This guy is so cool
@erans0496
@erans0496 2 года назад
Erik: " I didn't go to high school, but I assume in high school algebra you learn this...." Me: Drop from CS and cry...
@roushankumar-lu2ov
@roushankumar-lu2ov 5 лет назад
I'm in third semester,but this particular video seems to much difficult ,there are so many things in this I don't know
@sakules
@sakules 5 лет назад
wonderful teacher
@chinmaydas4053
@chinmaydas4053 3 года назад
Sir what is the best programming language for analysis and design of data structures and algorithms??...
@azizchafik
@azizchafik 4 года назад
in 42:06 I think we need to compute the sum of cost in each level not only the last !!!
@AmanGarg95
@AmanGarg95 8 лет назад
Did he just throw a Frisbee at 4:54 ? I cracked up xD
@orbik_fin
@orbik_fin 8 лет назад
I guess the idea is to somehow encourage participation. I'd like to know if there's a more in-depth study about this - does it enhance or take away concentration from the actual subject? (Or choice C - neither, it's just a bit of fun)
@GMPGIRI
@GMPGIRI 7 лет назад
let me know if u ever found an answer to it @orbik.
@TheKivifreak
@TheKivifreak 7 лет назад
sounds a little like dog training where you throw a frisbee as a reward for the dog.
@ashishjog
@ashishjog 6 лет назад
ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-HtSuA80QTyo.html Here you go watch at 26:27 in that video, Instructor: Srini Devadas, mentions about it!
@thinhnguyenvan7003
@thinhnguyenvan7003 3 года назад
53:07 "I believe in Tau so much, I got it tattooed on my arm..." wow,lollllllllllll
@wtw5002
@wtw5002 3 года назад
"Screw Pi" - omg i nearly died. That was hilarious. I deeply regret my decision to avoid STEM classes in high school and college. That was a terrible mistake.
@ka1wht
@ka1wht 3 года назад
It’s not too late to learn. Think of the ones you regret not taking and either purchase a book or take a class. One of the greatest things about our minds is that they are malleable.
@woosix7735
@woosix7735 Год назад
I like this guy
@stefanosmakris5641
@stefanosmakris5641 4 года назад
This was AWESOME! Thank you!
@iamshadmirza
@iamshadmirza 8 лет назад
This guy is amazing
@noguide
@noguide 6 лет назад
LOL 53:04 ^ 57:15 ^ 1:17:08
@rosenzhang1704
@rosenzhang1704 5 лет назад
why we must take the nth root of unity, cant we take like -1, 1, -2, 2 ....as X? This will also collapse?
@elliotwaite
@elliotwaite 5 лет назад
Squaring those numbers will give you 1, 1, 4, 4, giving you the set {1, 4} (a collapse of 4 numbers to 2), but if you square those again you get {1, 16}, which doesn't collapse the set any further. You need the collapsed set to collapse again when you square each value a second time, and then collapse again when you square the numbers a third time, and so on, hence the complex numbers. You could use the nth roots of any number, but using the nth roots of 1 is simpler and lends the alternative representation to represent amplitude and phase information in frequency space. If you used the nth roots of another number I don’t think the alternative representation could be interpreted the same way.
@haardshah1676
@haardshah1676 4 года назад
​@@elliotwaite 1:07:35 if the complex conjugate is just minus the power in the exponential, why did he write exp(-ijkT/n/n)? why the divide by n divide by n (again)? is it a mistake? (also sorry I asked as subcomment; I thought it'd get lost in the clutter otherwise)
@elliotwaite
@elliotwaite 4 года назад
@@haardshah1676 it looks like the second division by n was a mistake. He realizes this soon after writing it and erases it. Does that answer your question?
@shivamtomar2325
@shivamtomar2325 4 года назад
Nicely explained
@beback_
@beback_ Год назад
How does one perform FFT on a larger domain consisting of multiple cosets of a multiplicative subgroup of the field? I've heard it can be done but couldn't find any sources that explained how.
@LydellAaron
@LydellAaron 2 года назад
53:06, 57:15 takes a moment to give tau some respect. Big flex 💪
@pepehimovic3135
@pepehimovic3135 Год назад
Let me guess, it involves powers of 2?
@off4on
@off4on 4 года назад
I think he meant V\Y not V\A at around 29:00...
@junzhai1715
@junzhai1715 3 года назад
i think so too
@andrewolesen8773
@andrewolesen8773 6 лет назад
So is the Nfft value for the FFT function in the matlab signal analyzer app the same as the 'n value rounded to the next largest power of 2' he talks about in the video?
@kokomanation
@kokomanation 3 года назад
FFT sounds like fast Fourier transformation I don’t know what it is though
@MrAwesomeaditya
@MrAwesomeaditya 4 года назад
is it just me or does he look like post malone had a studious brother
@everaldoantoniomoreiraalve1023
@everaldoantoniomoreiraalve1023 11 месяцев назад
Amazing!
@ZuvielDrama
@ZuvielDrama 3 года назад
44:00 in this moment, all the other stuff about fft made a little more sense :-)
@jimaaman
@jimaaman 2 года назад
Did I come here planning to learn about the nth roots of unity and how polynomial representations can be exploited to improve the scaling of computational complexity... No Did I just spend an hour watching this guy because it is freaking interesting and incredibly well presented? You bet I did 😅
@RSPSupply
@RSPSupply 6 лет назад
Great Job!
@linuxmaster2327
@linuxmaster2327 4 года назад
I love you teacher
@64standardtrickyness
@64standardtrickyness 4 года назад
OMG why is this not the standard way of introducing FFT
@93nites
@93nites 6 лет назад
Taylor's polynomial seems to be O(n) eval,addn and multiplication
@fatihcihanhizlikan1427
@fatihcihanhizlikan1427 6 лет назад
I loved this video.
@shivamp5410
@shivamp5410 8 месяцев назад
Why do we still have x elements when we split the set and each part has n/2? I'm a bit confused on this part any help would be appreciated. Thanks.
@BuiDucLoc419
@BuiDucLoc419 5 лет назад
Best lecture
@cariyaputta
@cariyaputta Год назад
It's unfortunate that there's no discrete examples.
@mitocw
@mitocw Год назад
Problem sets with solutions (and other materials) are available on MIT OpenCourseWare at: ocw.mit.edu/6-046JS15. Best wishes on your studies!
@phillipabramson9610
@phillipabramson9610 2 года назад
So what is the math doing in practical terms? If I understand correctly, it's using the behavior of a signal over time to determine specific properties of that signal at specific moments. Is that correct?
@chrism7574
@chrism7574 Год назад
The FFT has a lot of applications. What it's most usually associated with is frequency decomposition. The FFT is just a computationally faster way to calculate the discrete Fourier transform of a periodic signal, which extracts the frequency components of a signal. This is used for basically everything that deals with periodic signals. More generally, the FFT can be expanded to include different roots of unity, like finite fields or integer integer rings, and that is used for cryptography and other various topics. As far as practicality, this algorithm is a major step forward in the advancement of our species. It touches nearly everything in our current world.
@kaustavguharoy4532
@kaustavguharoy4532 2 года назад
Marvellous
@shivanandt4532
@shivanandt4532 6 лет назад
@42.00, should not that be O(n^3) as we have total work = n + 2n + 4n + ...+ n*n = n ( 1 + 2 ...+n) = n*n*(n+1)/2 = O(n^3), he says it is O(n^2)
@abdu1998a
@abdu1998a 6 лет назад
actually you are wrong. It is a simple mistake n+ 2n +4n + 8n ... n*n = n( 1+ 2+ 4+ 8...n) and not n(1+2+3+4+5+6....n). Therefore, right part is not n*(n+1)/2. It is geometric series so right part is 2n-1*. Thus, it is O(n^2). * a^0 + A^1 .... a^k = a^(k+1)-1/a-1 in this case a = 2 and a^k = n.
@roadracer1593
@roadracer1593 19 дней назад
Dude. I admire your hair. I'm jealous. All my hair is falling out. I'll be bald soon.
@_HarshVerma
@_HarshVerma 2 года назад
"I didn't go to high school but I assume in high school you learned this" you dont have to flex like eric :(
@hektor6766
@hektor6766 5 лет назад
His sentient, verbal expression of tau is more eloquent than a tattoo could ever be. Eloquence is human, expression is animal, marks are for objects.
@PorkBoy69
@PorkBoy69 Год назад
That's a really pretentious way to voice the opinion you don't like tattoos, but okay lil bro
@distrologic2925
@distrologic2925 3 года назад
TAU IS A WHOLE CIRCLE
@qiguosun129
@qiguosun129 2 года назад
Pro Erik is fabulous
@aayushbajaj2260
@aayushbajaj2260 Год назад
holy crap, the tau thing
@nitishsandhu4462
@nitishsandhu4462 8 лет назад
I think there is one mistake at 15:36, when he wrote down samples to represent a polynomial of degree n. He took n samples to represent a polynomial of degree n uniquely. But this is untrue, to represent a polynomial of degree n, we need at least n+1 sample points, for all different x points.
@Davissb1aine
@Davissb1aine 8 лет назад
The polynomial is of degree n-1: (1 + x + ... + x^(n-1)). Therefore, you need n sample points to uniquely represent this polynomial.
@haardshah1676
@haardshah1676 4 года назад
1:07:35 if the complex conjugate is just minus the power in the exponential, why did he write exp(-ijkT/n/n)? why the divide by n divide by n (again)? is it a mistake?
@willlenk862
@willlenk862 2 года назад
Because he's trying to invert the V-matrix which requires a complex conjugate operation and then a divide by n. Note he later corrected the division by n (because the magnitude of the xk values must be 1), and deferred it to after the matrix multiplication
@kaiovieira230
@kaiovieira230 4 года назад
Awesome!
@bryanlozano8905
@bryanlozano8905 2 года назад
Dude, why are you erasing the chalkboard before I finish taking notes?
@kaushiksurikuchi
@kaushiksurikuchi 6 лет назад
Erik, the best
@64standardtrickyness
@64standardtrickyness 4 года назад
Does anyone have intuition as to why Fourier transforms pop up here?
@rodacoram
@rodacoram Год назад
Is divide and conquer a genetic algorithm?
Далее
R2. 2-3 Trees and B-Trees
30:45
Просмотров 219 тыс.
When Khabib dropped Conor McGregor 👀 #nocommentary
00:59
How many can you smash?🍫 IB : Florin
00:19
Просмотров 2,9 млн
2. Divide & Conquer: Convex Hull, Median Finding
1:20:35
Просмотров 201 тыс.
4. Divide & Conquer: van Emde Boas Trees
1:20:15
Просмотров 76 тыс.
16. Complexity: P, NP, NP-completeness, Reductions
1:25:25
26. Complex Matrices; Fast Fourier Transform
47:52
Просмотров 274 тыс.
Think Faster, Talk Smarter with Matt Abrahams
44:11
Просмотров 1,6 млн
Meet the Mind: The Brain Behind Shor’s Algorithm
9:12