Тёмный

The Next Revolution in AI and ML 

Dimitri Bianco
Подписаться 46 тыс.
Просмотров 8 тыс.
50% 1

The next revolution in AI and ML is simplification of models. To get to this simplification, we need to do more math to get simpler structures. This is a combination of math and theory.
Even from a current model development standpoint, most people fitting models overfit large models when smaller simpler models exist. AI is over bloated and leaning on the hardware too much. The real edge in tech and finance will come from getting a similar solution but faster and more transparent (explainable).
Website:
www.FancyQuantNation.com
Support:
ko-fi.com/fancyquant
Quant t-shirts, mugs, and hoodies:
www.teespring.com/stores/fanc...
Connect with me:
/ dimitri-bianco
/ dimitribianco

Опубликовано:

 

4 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 59   
@victorquirola7277
@victorquirola7277 8 дней назад
This was nice! Keep doing this types of videos, a little technical , good explanation and not long! Thank you!
@daymaker_algo
@daymaker_algo 10 дней назад
Thank you, very interesting!
@visunashokkumar1782
@visunashokkumar1782 9 дней назад
I was deciding and narrowing down the topic for my PHD and this sort of resonates with me.
@giuliobellini8597
@giuliobellini8597 11 дней назад
Hi Dimitri, I recently discovered the work of Cynthia Rudin, PI of the Interpretable Machine Learning Lab at Duke University. She argues that we should focus on creating complex algorithms that return sparse and intrinsically interpretable models, rather than simple algorithms that return complex and less interpretable models (e.g. random forests or GBM). What do you think about it?
@DimitriBianco
@DimitriBianco 11 дней назад
I would have to read some of their research to understand what she is getting at. It sounds like we align however our definitions of complex may differ. Often it takes leaps in math to get better complex solutions however over time we start to understand them better which results in more simplified versions.
@ashleigh3021
@ashleigh3021 4 дня назад
I’m sure the models will get faster, more interpretable, at lower cost. But you cannot have AI without a world model and these are the next generation of search engines, not AI.
@FinianAllen4
@FinianAllen4 10 дней назад
Hey Dimitri, as someone about to start college and who is interested in the field of quant finance, thank you for your perspective always
@pablo313khaos9
@pablo313khaos9 10 дней назад
Hello Dimitri 😀I am a Math graduate and a Data Science/Machine Learning MSc student about to begin my thesis. Over the past 3-4 months, I have developed a strong interest in Quantitative Finance and would like to focus my thesis on this area. Although I lack professional and academic experience in Quant Finance, I am eager to explore it further. Could you please suggest a few topics for my thesis? I don't know wich of the options I can follow (Sentiment analysis of financial news, AI-Driven portfolio optimization, etc.) as I am not very aware of the market last trends Thank you very much!
@jasdeepsinghgrover2470
@jasdeepsinghgrover2470 10 дней назад
Hey Dimitri! Thank you for another amazing video! I think I can speak a bit on the tech industry side. You are right that mega differences come from coming up with novel mathematical solutions to existing problems which might be optimal in various ways. But, tech actually relies a lot on tinkering. For example, even now some of the best models in NLP and CV (LLMs and diffusion) use math techniques developed decades ago. Even the idea of predicting the error and simply using MSE in diffusion is so simple that i doubt they did the math before trying it randomly out of luck. Similarly, there are so many aspects like system design and the actual working of the internet, that ideally these should fail mathematically. The entire set of routing algorithms are a lot about best effort which means the given performance is not mathematically guaranteed. Coming back. An engineer might come up with an amazing heuristic based model for complex financial modeling tasks ehich might be wrong in certain cases but at the same time it may not make oversimplifying assumptions commonly used in Math to get some solvable (empirical or analytical) solution..
@shehzaibirfan
@shehzaibirfan 11 дней назад
Hey Dimitri. I can't thank you enough for teaching us the importance of Maths. It has literally changed the career trajectories for good. GenAI is very cool now a days but it seems that most people (obviously not all) are just throwing it around in the meetings without even knowing the actual use case for themselves. "No amount of Maths is enough"...
@in_neerajpandey
@in_neerajpandey 10 дней назад
Full agreement!
@williamxion2806
@williamxion2806 4 дня назад
hi dimitri, i was just wondering what kind of math do you think we will need in the next phase of ai/ml after this generative ai bubble/hype phase passes?
@Eta_Carinae__
@Eta_Carinae__ 21 час назад
Yeah, honestly I bring up similar problems often with models that don't even have speed as a requirement; that at the end of the day with all these models, odds are that they aren't even going to converge on the true population parameter. It's depressing if you're looking for explainable AI.
@yusufspahi1693
@yusufspahi1693 11 дней назад
Hey dimitri, are you going to do a video on going from physics to quant finance any time soon?
@DimitriBianco
@DimitriBianco 11 дней назад
I was going to do one on economics to quant video soonish. I can look into a physics one. I don't interact much with physics though so it'll take me a bit of work but it can be done.
@nicholasdaskalovic4163
@nicholasdaskalovic4163 10 дней назад
Hey, what are your thought on Quantum computing generally and possibly for finance? Most people I talk to in industry dismiss it as it's not coming any time soon but as a MS comp sci student I find it fascinating.
@DimitriBianco
@DimitriBianco 9 дней назад
Yes there is work being done on quantum computing. Some firms are getting closer than others. I'm actually reading an interesting book right now on market making with quantum computing. It explains why stochastic processes don't work well and how a quantum framework works better. The is fairly expensive and quite small but it called, "Quantum Markets". The company FMI Technologies actually presented at the conference I just held. Here is a link to the book if you are interested (affiliate link). amzn.to/45Gtj12
@sentralorigin
@sentralorigin 11 дней назад
4:06 talking like a true physicist there 😂
@iFastee
@iFastee 10 дней назад
this whole video assumes that AI and ML solve anything in Quantitative finance... maybe on the sell side it manages risk, on the buy side it does nothing. this video makes it seem like using AI is a plus in ur journey in markets.
@sentralorigin
@sentralorigin 10 дней назад
@@iFastee i think you replied to the wrong comment
@noor-rrr
@noor-rrr 9 дней назад
@@sentraloriginahhaah
@HDSourZ
@HDSourZ 11 дней назад
Any book recommendations on this for DL grad student?
@DimitriBianco
@DimitriBianco 11 дней назад
What is DL?
@vibhudalal901
@vibhudalal901 11 дней назад
@@DimitriBianco Deep Learning?
@junal27
@junal27 11 дней назад
sufficiency
@hackerborabora7212
@hackerborabora7212 11 дней назад
Does space state models is good in financial market
@DimitriBianco
@DimitriBianco 11 дней назад
Yes, finance uses state space models. Some firms use them more depending on the problem they are trying to solve.
@leonmozambique533
@leonmozambique533 11 дней назад
js was hiring people to work on SSMs
@alvarojneto
@alvarojneto 8 дней назад
You dismissed the impact that quantum computing will have as a "know-it-all" blackbox, which, fair, nothing will ever know everything. But is there no threat of a small set of quantum computers knowing everything relevant enough - and fast enough - to squeeze out all competition - including new quantum computing entrants?
@DimitriBianco
@DimitriBianco 8 дней назад
No there will never be a computer or model good enough to predict humans. By nature humans are fairly unpredictable.
@ireneuszpyc6684
@ireneuszpyc6684 8 дней назад
never good enough to predict any seriously complex system, like a civilisation or weather
@Jordan-tv9we
@Jordan-tv9we 10 дней назад
"No, it's not going to be the tech industry." I laughed so hard. This is so true. Subscribed for a long time, always love your explanations on this stuff!
@nischaylando4132
@nischaylando4132 6 дней назад
Why are stock exchanges not fair?
@DimitriBianco
@DimitriBianco 5 дней назад
I'm not sure if the outcome but look up Haim Bodek lawsuit. There was even a book by him on the issue. Essentially markets aren't just who is fast but preference was being given to larger players like Citadel. If it was fair, size wouldn't matter.
@ZalexMusic
@ZalexMusic 5 дней назад
PFOF
@pablomena585
@pablomena585 11 дней назад
Its so weird how you say its not groundbreaking, and proceed to mention things that weren't possible 9 months ago. You need perspective on what this applied math means to our species.
@DimitriBianco
@DimitriBianco 11 дней назад
Much of the technology has been available for a long time however the addition of an interface is the only recent change to gen AI. AI is much older than many realize.
@pablomena585
@pablomena585 11 дней назад
@DimitriBianco mmm, the tech wasn't available, the math was there. You are mixing the fact that people talked about these concepts for years, with them being technologically available or useful
@musicarroll
@musicarroll 10 дней назад
AI tools may level the playing field for average performance, but you're absolutely right that that won't create barriers to entry like sophisticated math can do. Think Jim Simons.
@AA-ro8kt
@AA-ro8kt 11 дней назад
Dmitri. There are too many sharp angles on your face
@ultronix764
@ultronix764 6 дней назад
lol the irony is this script was generated by an ai lol😂
@leonmozambique533
@leonmozambique533 11 дней назад
your entire thesis is fundamentally wrong. People aren’t interested in AI for financial modeling. The holy grail of AI is artificial general intelligence. A foundational model that can solve generalized problems. Models in quantitative finance are more or less glorified regression. Do I think that the current LLM/transformer stacking hype will help us achieve AGI? No. But the end goal of AI research has nothing to do with finance and honesty this video makes you look like an old boomer that doesn’t have a vision. But I wouldn’t expect someone who’s working in risk modeling at a mid tier bank to be a visionary anyways.
@DimitriBianco
@DimitriBianco 11 дней назад
You really should look at people's LinkedIn before commenting.
@michaelmraz2707
@michaelmraz2707 9 дней назад
You know nothing about high finance
@AllemandInstable
@AllemandInstable 9 дней назад
maybe you could provide details about that statement then
@michaelmraz2707
@michaelmraz2707 9 дней назад
@@AllemandInstable he knows nothing more than just use stats and algorithm to do day trading like degenerates. Only RenTech is credible in this space. However, High finance is much more than that. And it involves trillions of dollars of investments vs billions of daytrading with a net of probably just few millions or big losses.
@michaelmraz2707
@michaelmraz2707 9 дней назад
@@AllemandInstable did my comment just got deleted lol
@AllemandInstable
@AllemandInstable 8 дней назад
@@michaelmraz2707 ?
@ireneuszpyc6684
@ireneuszpyc6684 8 дней назад
“comments deleted” - sometimes RU-vid is glitchy
@vladanovicluka7709
@vladanovicluka7709 11 дней назад
Why do you keep talking about quants when you are not one, stop embarrassing yourself. On top of that, you are not AI expert. The only thing you questionably have knowledge of is ML but no one considers you authority there. I am not trying to be rude, you just need to ground yourself into reality.
@billykotsos4642
@billykotsos4642 11 дней назад
What? He is literally a quant... and yes you are rude ..
@tr0wb3d3r5
@tr0wb3d3r5 11 дней назад
Isn't he an experienced quant tho
@avy1
@avy1 11 дней назад
someone forgot to take their meds
@sentralorigin
@sentralorigin 11 дней назад
pretty sure this is an AI comment designed to engage in nonsense argument
@WarloyJenkins
@WarloyJenkins 11 дней назад
He is a quant, just not the kind that does algorithmic trading at a big fund. Model Development is a quant role, most jobs that you see posted on linked in for "Quantitative Analyst" are model development. There are also Quant developers, which are really just software engineers that have a reasonably good understanding of the financial world and models.
Далее
The moment we stopped understanding AI [AlexNet]
17:38
Просмотров 171 тыс.
Me: Don't cross there's cars coming
00:16
Просмотров 2,2 млн
2024 Fancy Quant Honorable Mentions
16:47
Просмотров 3,8 тыс.
The Man Who Solved the World’s Hardest Math Problem
11:14
ML Was Hard Until I Learned These 5 Secrets!
13:11
Просмотров 226 тыс.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Is the Intelligence-Explosion Near? A Reality Check.
10:19
How Britain Became a Poor Country
41:36
Просмотров 793 тыс.