Тёмный

MusicLM is a GAMECHANGER for ML Text to Music Generation 

Nicholas Renotte
Подписаться 266 тыс.
Просмотров 34 тыс.
50% 1

Get notified of the free Python course on the home page at www.coursesfromnick.com
Sign up for the Full Stack course here and use RU-vid50 to get 50% off:
www.coursesfromnick.com/bundl...
Hopefully you enjoyed this video.
💼 Find AWESOME ML Jobs: www.jobsfromnick.com
Links:
MusicLM Examples: google-research.github.io/sea...
Paper: arxiv.org/pdf/2301.11325.pdf
MusicCaps: www.kaggle.com/datasets/googl...
AudioLM Examples: google-research.github.io/sea...
Paper: arxiv.org/pdf/2209.03143.pdf
Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV
Happy coding!
Nick

Наука

Опубликовано:

 

9 фев 2023

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 44   
@NicholasRenotte
@NicholasRenotte Год назад
Whatcha reckon guys? More ML 411s? I think we need to do some more where we can have a run with the code.
@darkwraithcovenantindustries
Hi Nicholas, great video! Do you know if there is a tool that exists that can generate new samples based on a text prompt? Basically if I want a “TR-909 kick drum sample run through a boss ds-1 processed by an alesis nanoverb and finally sampled through an sp-1200.” And then the model generates a sample that I can use in my music. Or something like “snare drum from despacito mixed with a tr-808 tom and metallica death magnetic snare” and it builds a sample based on those criteria?
@darkwraithcovenantindustries
If not, how hard would this be to develop a program that does something like this?
@fahnub
@fahnub 11 месяцев назад
Yesssir
@divyachopra2369
@divyachopra2369 Год назад
You're just awesome nick! Every morning I see one of your vd or shorts and I am charged up for the day and go to my job as a n excited data scientist 😌❤️
@ysfy5106
@ysfy5106 Год назад
Hello, I just came across your channel this morning, and it has been 4 hours that I'm watching your videos and I just can't stop! You're really doing such good work. Also, I have a really interesting project that I am working on, it is about generating a quiz from a text using NLP. But I'm really stuck right now. Can you help me please with some advice or an algorithm I could use and work with? Also, it could be an interesting video idea! Maybe a 15mins challenge haha.
@alx8439
@alx8439 Год назад
Some ppl are concerned that AI can replace human artists or musicians and trying to ban such models from being released / used / trained. I find this the dumbest move. If I love some musical band, I'll keep looking after them and purchase their new albums. I don't care if someone tries to rip them off to make his own music in the same style. The same goes for artists.
@NicholasRenotte
@NicholasRenotte Год назад
Yeah I’m with you on this, I think the idea of being able to generate stuff is great…just not at the expense of the original artists! Although, it’s the Wild West out there right now.
@noob_techie2475
@noob_techie2475 Год назад
@@NicholasRenotte I think as we have factory made artifacts, still hand made ones are more valued and get higher price as well, I think same will go for authentic music or any other art form.
@alx8439
@alx8439 Год назад
@@noob_techie2475 good point. The most screaming we hear now is coming from mediocre artists who couldn't withstand any form of competition, I guess. Real artists who are professionals, do not care
@youssefelgharib7092
@youssefelgharib7092 Год назад
Love your videos, keep it up ❤
@ashleysami1640
@ashleysami1640 Год назад
Who knew tribal drums and flute got the party started 🪩
@NicholasRenotte
@NicholasRenotte Год назад
LOOOOOL, it’s a vibe
@kushagrasharma5902
@kushagrasharma5902 Год назад
I'm planning to recreate MusicLM with the public datset, starting today
@NicholasRenotte
@NicholasRenotte Год назад
Oooooh, lmk how you go!!
@robinchriqui2407
@robinchriqui2407 Год назад
Hi Nicholas amazing video thanks for sharing, are you planning to do a video with the implementation in Python?
@vivival2742
@vivival2742 Год назад
Just like stable diffusion has trouble generating images including sensical text, MusicLM has trouble generating words that make sense as it's not the main focus and there's not enough processing done around the texts of training songs.
@NicholasRenotte
@NicholasRenotte Год назад
Yeah I figured it had an acoustic resemblance to true lyrics but synthesising voices was a bridge too far. Can’t imagine that’s far away though!
@hspank
@hspank 10 месяцев назад
it is millions of miles away from every day usefulness. reminds me of texas instruments speech & spell for music
@alexyu4629
@alexyu4629 Год назад
Real interesting! Another thing I heard recently is how copyright will be handled when bots are sampling real human artists 🤔
@spranav1998
@spranav1998 Год назад
Can you make a video of what transformer models are and give a simple example of how to build one. love your videos keep it up.
@NicholasRenotte
@NicholasRenotte Год назад
In the works 😉
@SMTKMR68
@SMTKMR68 Год назад
Hey hey I am new to deep/machine Learning. Which one I need to learn first keras or Tansorflow .
@nikhilmudgal8541
@nikhilmudgal8541 Год назад
It's like you think and there is already something for it. Thanks @Nicholas Renotte for talking about it, this will help me a lot in my upcoming project 🤞🤞.
@NicholasRenotte
@NicholasRenotte Год назад
Hey!!! So glad you liked it, I’m working like crazy right now to much this stuff out. Pumped you checked it out 🙏
@myekuntz
@myekuntz 4 месяца назад
Death Metal Song ??? No way , I’m looking for more of a thrash metal/EDM but Death Metal will be a good start 😊
@manan5
@manan5 Год назад
hey nicholas, can you make a video on latest microsoft paper on VAll-E. IT is almost unbelievable it clones your voice with only 3 seconds voice sample. + Bonus if u can help implementing it too! as there exists very few implementations of the same with unclear instructions!
@NicholasRenotte
@NicholasRenotte Год назад
Will add it to the list, trying to catch up on LLMs right now but will look at it!
@quintonlewis7201
@quintonlewis7201 Год назад
How do I use it ?
@yolow8126
@yolow8126 Год назад
How did you learn machine learning and deep learning
@venkatakrishnanramesh4718
@venkatakrishnanramesh4718 Год назад
Is it able to have an api of musicml i want them to be in a app
@punkrosezer01197
@punkrosezer01197 Год назад
im confused, can we try it out or not?
@zzzzzzz8473
@zzzzzzz8473 Год назад
fantastic breakdown ! excited to see the development , the examples sound great and love the story mode and conditional mode . however without code its unproven and unusable , like we are just trusting the results based on reputation that these are not the most cherry-picked examples / indicative of the results . if the dataset is ok to release then why would they not prove their model works . code is truth , until it is externally reproduced then its fluff .
@NicholasRenotte
@NicholasRenotte Год назад
Yeah agreed, it’s a tough one right? It’d be amazing if we could give it a crack!
@lloydchan9606
@lloydchan9606 Год назад
programmers are the new rockstars!
@NicholasRenotte
@NicholasRenotte Год назад
🤘🏽
@dlouise64
@dlouise64 3 месяца назад
hahaha love your reactions
@petneb
@petneb Год назад
I don't think we should limit the creativity of humans in general just because someone is making money out of it. We should find a new paradigm for living that is based on other values than money now we have the chance.
@tilakrajchoubey5534
@tilakrajchoubey5534 Год назад
Do you have a phd in ML?🙄🙄
@hspank
@hspank 10 месяцев назад
its like chatgpt, but 12 years ago. music AI is the area with results which sounds utterly untalented, keeping people unexited and unimpressed, for good reasons if you have had anything to do with music in your life, that means. lets say you need to create elevator muzac, there are other generative mass producing methods in digital music which do serve better than current transformer models, AI is SOOO behind in music - not just in sound quality, but in all in all convincing usability, maybe for a reason. yeah you can make a AM radio quality of snoop dog which might you make giggle, you could use it as an effect such as autotune, but as all in all black box replacing musicians, show me an example. AI might be bad for all kind of creative bullshit jobs, with minimal creativity involved, or areas of craftmenship, as in applied arts, such as voice actors in gaming, or illustrators in the print sector. but music? go show us.
@samirshaikh862
@samirshaikh862 Год назад
Job Offer! Can anyone help me install Google's LM music generator? I can pay for your time!
@ne2667917
@ne2667917 Год назад
But...
@cheapguitar1
@cheapguitar1 Год назад
Good God the Micky Mouse editing and sfx of this video are annoying.
@romanrojas8588
@romanrojas8588 Год назад
It all sounds like 💩 not quite there yet, sounds like a machine.
Далее
A.I. MIDIs is all you need!
9:01
Просмотров 303 тыс.
Machine Learning Projects You NEVER Knew Existed
15:20
Просмотров 158 тыс.
5 AI apps that will make you a BETTER musician
14:42
Просмотров 444 тыс.
Поворот смартфона ↩️
0:32
Просмотров 76 тыс.