Should Validation Differ with Machine Learning?

Подписаться 49 тыс.

Просмотров 1,4 тыс.

50% 1

Should Validation Differ with Machine Learning? No!
Machine learning is nothing more than a small space of statistics. We are building models on the same data sets to model the same problems. Why would the process change for this? Why would you blindly use a method and do minimal or no testing? I ask these because the machine learning and data science community has been trying to convince people that ML models are a magic pill to fix everything. It doesn't change much besides a new approach with the same data and business problem restrictions.
For validations make sure to review the data sampling and cleaning, conceptual soundness, model performance, and model governance.
Model Validation: Detailed Process
• Model Validation: Deta...
Agus Sudjianto Interview
• Machine Learning in Fi...
Decision Tree Number Space Details
• Decision Tree Number S...
Website:
www.FancyQuant...
Support:
ko-fi.com/fanc...
Quant t-shirts, mugs, and hoodies:
www.teespring....
Connect with me:
/ dimitri-bianco
/ dimitribianco

Опубликовано:

1 окт 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 21

@grahamsayle 6 месяцев назад

Sure I’ll watch this at 4:00 am

@DimitriBianco 6 месяцев назад

Lol, you must be on the west coast.

@grahamsayle 6 месяцев назад

@@DimitriBianco sure am

@nassimelaflej5107 6 месяцев назад

Can you explain what you mean by number spaces ?

@sentralorigin 6 месяцев назад

i think in mathematical terms, he means domain or pre-image/inverse image

@DimitriBianco 6 месяцев назад

Here is a detailed video on it. I also have a simple video which is more straight to the point if you search. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-S1Yyn9Vs5Tk.htmlsi=vJLe_UET5GY9ZSgt

@nickh7681 6 месяцев назад

I've been having success using GBDTs for OOS/OOT predictions for adjustments to existing financial models to better reflect the idiosyncrasies of a more recent market/rate environment. However, as you say, you need to be especially careful to ensure the model is sufficiently simple and stable for it to be usable. And, again, this model is only predicting relatively small but still material adjustments to an existing set of pricing models. I've also been careful to prescribe the limitations of the model, as you mention (e.g. we dont have a sufficient number of samples with high x and low y to provide a meaningful prediction or we can expect more flat residuals across feature A, but inversely scaling residuals across feature B). The model has also been good at helping to visualize changes across certain features in time as the moving-window of prediction has changed (e.g. specific counterparty behavior in certain OTC markets relative to the market as a whole)

@DimitriBianco 6 месяцев назад

That's really interesting.

@vyompatel4517 6 месяцев назад

It would be great to see a video discussing measure theory and its applications in specific ML models. I still haven't found a resource directly linking measure spaces and ML models.

@DimitriBianco 6 месяцев назад

Start here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-S1Yyn9Vs5Tk.htmlsi=13vKjJiC0KLb1V1g

@DimitriBianco 6 месяцев назад

I'll consider this for future videos.

@Fibozzy 5 месяцев назад

I am a quant and 2/3 failure rate is honestly pretty good 🤣 I think 1/10 or fewer of what I come across works to our standards

@DimitriBianco 5 месяцев назад

I was hated by most developers especially when I would make them go down the math path and explain all the issues.

@shivamd23 6 месяцев назад

hi dimitri, can any one who has started their career as quant researcher in HFT like Tower Research etc. can make transition into buy side firms like goldman, jp morgan etc after working in hft for 5-6 yrs? Please reply Thanks

@DimitriBianco 6 месяцев назад

Investing like HFT is considered buy side and the banks are considered sell side. Yes, it is possible to transition but as you specialize it can become more difficult.

@shivamd23 6 месяцев назад

@@DimitriBianco Thanks For Your Reply

@buffordbutters6284 5 месяцев назад

Good stuff bro!

@gamer12353 6 месяцев назад

Would love to know your oppinion on neural SDE, SPDE learning or Physics Informed Neural Networks (PINNs) that can either learn a solution space given a mathematical restrictions or a model like a SDE, or learn the SDE and their solutions directly from the data.