Тёмный
No video :(

Working with time series data in MySQL 

PlanetScale
Подписаться 38 тыс.
Просмотров 21 тыс.
50% 1

To learn more about PlanetScale, head to planetscale.co...!
💬 Follow PlanetScale on social media
• Twitter: / planetscale
• Discord: / discord
• TikTok: / planetscale
• Twitch: / planetscale
• LinkedIn: / planetscale

Опубликовано:

 

25 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 80   
@DevanSabaratnam
@DevanSabaratnam 7 месяцев назад
I've been working in MySQL for over 20 years now, but learned a TON from this video - Thank you for putting out such great learning content Aaron!
@ahmad-murery
@ahmad-murery 7 месяцев назад
Wow Steve's graphic design skill is getting better, compared to the previous video Aaron in this video looks more realistic and is barely distinguishable from the real one 👍😁 anyway, even when the query is fast enough, we also need to consider the number of times we may execute it (multiple users requesting the data), so using a summary table is definitely helpful here. Thanks Aaron,
@edgars-strods
@edgars-strods 7 месяцев назад
Maybe I did not catch the specific point why window function was used here instead of simple GROUP BY "bucket"?
@mentalmaniac76
@mentalmaniac76 7 месяцев назад
my guess is so that you are able to have multiple, separate, "groups" and operate on them all within the same query
@xelhuajosephcoronaperez3531
@xelhuajosephcoronaperez3531 7 месяцев назад
@planetscale???
@PlanetScale
@PlanetScale 7 месяцев назад
Window functions are a great way to compute running totals, averages, sums, etc. Or do something specific with the first or last row. Or peek at the next row or the previous row within a group. Or group by different things within a single query. They're very powerful!
@CodeErrorOfficial
@CodeErrorOfficial 7 месяцев назад
@@PlanetScale yes but this specific task would be better with group by. still a great thing to know
@victorcosenza254
@victorcosenza254 7 месяцев назад
in this case it could be done with groupby right? Or im missing something?
@hans-joergwahmkow2621
@hans-joergwahmkow2621 7 месяцев назад
If I understand this correctly, one important feature of a window function is that everything inside is on a rolling basis. That is for sure not something you could ever do with a simple GROUP BY. I do have an application where this may actually come in very handy. Thanks Aaron, great content as always!
@anderskozuch7838
@anderskozuch7838 7 месяцев назад
Thank you for this video!! Wonderful to dive into SQL like this and absolutely fantastic to see your enthusiasm Aaron. It's very inspiring and I am really excited to learn about the summery table when you make that video. Such a nice idea to make a query faster by just sort of "computing it before its needed" !
@thewayis_meh987
@thewayis_meh987 7 месяцев назад
Classic Aaron, using MySQL as a calculator
@PlanetScale
@PlanetScale 7 месяцев назад
Haha didn't even think about it
@alexrix4063
@alexrix4063 7 месяцев назад
Video request: Geospacial indexing
@referralhelper
@referralhelper 7 месяцев назад
One of the best RU-vid channels when it comes to sql!
@warutt5356
@warutt5356 7 месяцев назад
Great job! So far, the best tutorial clips on common windows functions.
@ZacZajdel
@ZacZajdel 7 месяцев назад
The fact this content is free is outstanding. Beyond blessed to be a developer in 2024!
@OnlinePseudonym
@OnlinePseudonym 7 месяцев назад
Amazing! Been trying to do this for ages! The explanation is great.
@jfdirienzo
@jfdirienzo 7 месяцев назад
This channel just keeps on getting better 😍
@jricardoprog
@jricardoprog 7 месяцев назад
Thank you!!! Good to see this type of content. 🍻
@barmalini
@barmalini 7 месяцев назад
Thanks for a great video. SQL is clearly not amazingly fast when it gets to bigger datasets and more complex analysis. Wouldn't it be beneficial to use another tool for a task like this, something like Spark perhaps?
@massaynus
@massaynus 6 месяцев назад
GROUP BY looking at you menacingly from the corner 😂
@mogadanez
@mogadanez 6 месяцев назад
with rollup table potential problem is with presenting data in different timezones, especially when doing stats per day
@d47im5e
@d47im5e 7 месяцев назад
Cool, detailed, niche case handling explanation video, keep it up!
@noamanahmed1
@noamanahmed1 7 месяцев назад
Video Suggestion How to handle case where you have to insert n numbers of rows and then you need the primary key(id) for those to be inserted in a child row WITHOUT making n insertion queries
@dhawaljoshi
@dhawaljoshi 7 месяцев назад
MySQL lacks mviews, anyway to get similar functionalities using just DB options. I've experimented with triggers on insert,update,delete that reruns the query to fill the table but incase of multiple inserts or updates it's not quite what was expected.
@GringoDotDev
@GringoDotDev 7 месяцев назад
another video I'd be very interested to see is a deep dive on MySQL replication
@conceptrat
@conceptrat 7 месяцев назад
Multi master is so much fun 🤔😬
@cagdasucar3932
@cagdasucar3932 7 месяцев назад
Idea for your summary table video: in order to maximize performance and reduce unnecessary storage, I like to do summary view + index instead of an actual table.
@shohruxshomaxmudov1225
@shohruxshomaxmudov1225 7 месяцев назад
This is like learning chess openings: at first everything is clear and easy, but in the end, your mind will explode.
@chao-chienchen4393
@chao-chienchen4393 7 месяцев назад
Perfect content right there!
@xesau
@xesau 7 месяцев назад
Can't you just SELECT MIN(dt), AVG(v), MIN(v), MAX(v) FROM timeseries GROUP BY FLOOR(UNIX_TIMESTAMP(dt) / bucket_length_in_secs)?
@michaelmo5
@michaelmo5 7 месяцев назад
Bump! I was thinking the same.
@mogadanez
@mogadanez 5 месяцев назад
I get same output with groupBy but times faster, only one thing missed is first_value(dt), but it can be replaced by MIN(dt)
@developertpl
@developertpl 7 месяцев назад
17 minutes in and still asking myself why are we not grouping by key and bucket instead of trying to get the last row of each group.
@Szarlus
@Szarlus 7 месяцев назад
My thoughts exactly as well :P Probably could even do `GROUP BY bucket ORDER BY bucket`
@goaserer
@goaserer 7 месяцев назад
For the aggregations a simple group by should work as well. It would complicate the query in case you actually need the fields for first- and last timestamp (although one could be calculated back from the bucket). In the end using window functions was most likely the more interesting and educational topic for a video, even though the simple example could be solved in other ways
@developertpl
@developertpl 7 месяцев назад
@@goaserer I think it’s more like a leading video for the summary tables topic. I recently worked on a topic like this so I keep seeing group by solutions everywhere I look.
@Szarlus
@Szarlus 7 месяцев назад
@@developertpl I agree that showing window functions approach here is a nice educational approach. However, since it was mentioned that it is a no go for PlanetScale, it would be nice to also show the group by approach as an alternative here. Especially after we filtered only last record of each bucket which is literally what would group by achieve. From my point of view window functions are best used when you're reviewing per-record data in context of its group/bucket, which wasn't the case here. Tl;dr I enjoyed the video and always appreciate videos on this channel as they are of high quality and very informative. Just pointing out showing group by approach as well would make it "whole" :)
@developertpl
@developertpl 7 месяцев назад
@@Szarlus Great content for sure! Always a pleasure.
@JacoBoogie
@JacoBoogie 7 месяцев назад
Thanks Steve!
@jackjsy
@jackjsy 7 месяцев назад
Perfect timing!
@BloodyClash
@BloodyClash 7 месяцев назад
😁only understand about 1% but i'm sooo impressed what you are able to and also what mysql is capable of. i only use it as a middleman in my java and c# programs
@fredyy
@fredyy 7 месяцев назад
Why don't just group by bucket and use mysql's AVG function to get the average value in the bucket?
@hannielgutierrez9139
@hannielgutierrez9139 7 месяцев назад
Hi. I wanna thank you for beeing a great teacher. I have learnt a lot of things from you. I have a question, traditionally, when i have the case where i need to do some calculations, and the reuse them, I usually create a temporary table, so that i can consume the data that has been calculate and not repeat it. What would it be your recommendation , use subqueries, use temporary table or the one that I just leaned, the with utility.
@userasd360
@userasd360 7 месяцев назад
Isn't summary table similar temp table?
@abdelilahou2822
@abdelilahou2822 7 месяцев назад
I dont use mysql i dont even use planetscale (no offense) but i learn alot of things from you, and I like how you explain stuff
@zeratax
@zeratax 7 месяцев назад
slick animations!
@user-lx9tx8ie8o
@user-lx9tx8ie8o 7 месяцев назад
SAD there is no more hobby plan in PlanetScale, :/
@Vali615
@Vali615 7 месяцев назад
What about data gaps?
@RajveerSingh-vf7pr
@RajveerSingh-vf7pr 7 месяцев назад
Hi PlanetScale, I have a Table, with one column, which are the timestamps on which server was observed alive. I want to write a select query, which returns me the data for every minute, if there exists a timestamp in that minute, 1, else 0.
@GringoDotDev
@GringoDotDev 7 месяцев назад
this is great!
@LenWoodward
@LenWoodward 7 месяцев назад
If you keep making videos like this, my `favourites` saved list is just going to look like your channels `videos` page.
@userasd360
@userasd360 7 месяцев назад
can you provide the data file for the data that you have used?
@YandiBanyu
@YandiBanyu 7 месяцев назад
Is there an advantage counting these on the database level rather than the application level? Strictly speaking, is there any performance advantage when doing this calculation on the database?
@_MB_93
@_MB_93 7 месяцев назад
It is faster First, you don't pull tens of thousands of rows over the network Second, even if MySQL is not optimized for timeseries data, it is still dozen of times faster than say, Javascript or Java. After you got the grouped result which has reduced size, then you pull that data to application level and display them as charts
@YandiBanyu
@YandiBanyu 7 месяцев назад
@@_MB_93 But, will it create another bottleneck elsewhere? I mean, database connection is a resource. Will performing calculation hold those connections? Because if it is, then wouldn't it be better to just dump data and then perform calculation on the application side since the application server is typically easier to scale than db server? But of course, this also needs to be performed after profiling.
@_MB_93
@_MB_93 7 месяцев назад
@@YandiBanyu It is a bottleneck no matter where you put it, its just that database is a specialized software for aggregating and transforming data, I personally think it is "re-inventing the wheels" if things such as "group by" is performed on application side. As for scaling, well, as Aaron said in the video, MySQL can take you a long long way before you actually need it.
@YandiBanyu
@YandiBanyu 7 месяцев назад
@@_MB_93 yeah, there will always be bottleneck somewhere. But some of it is easier to solve than others. I agree that not many applications will scale beyond what RDBMS such as MySQL offer, but it is still good to keep in mind too when doing costly operations on the database level. After all, it is (IMHO) harder to reduce the bottleneck of a single database server (before going to a more complex clustering strategy) than say, spin up another server instance behind a load balancer. This can matter when making an application that needs on premise data for some security/legal reasons.
@joelkuijper
@joelkuijper 7 месяцев назад
Have you ever heard of an espresso martini?
@Wizatek
@Wizatek 7 месяцев назад
Can't you just group by the bucket calculation?
@JakobStrasser
@JakobStrasser 7 месяцев назад
Always forget the end on the case. Every time.
@milad8589
@milad8589 7 месяцев назад
🤯👏
@testdummy6792
@testdummy6792 7 месяцев назад
With all the talk on indexing, what does it really do? Is there such a thing as too many indexes? I'd imagine there's eventually a limit, either through practicality or performance, stopping you from adding an index for each and every column.
@TheEkkas
@TheEkkas 7 месяцев назад
MySql Gandalf
@davidharting3119
@davidharting3119 7 месяцев назад
brb gonna go build an APM tool
@nikhilpsathyanathan
@nikhilpsathyanathan 7 месяцев назад
Totally new for me😅
@mityukov
@mityukov 7 месяцев назад
GROUP BY on steroids 😅
@sililoconnect8846
@sililoconnect8846 7 месяцев назад
😅😂😂😂😂
@SashNone
@SashNone 7 месяцев назад
I was lost around 10 minutes in.....
@batvetone
@batvetone 7 месяцев назад
If we have a bucket as calculated column, would group by do the job?
Далее
You don't need NoSQL (use MySQL)
31:26
Просмотров 74 тыс.
I Built a WATERPARK In My House!
26:28
Просмотров 13 млн
microsoft doubles down on recording your screen
10:00
Easy database indexing strategies
36:03
Просмотров 24 тыс.
Serverless Doesn't Make Sense
10:13
Просмотров 365 тыс.
Microservices with Databases can be challenging...
20:52
Pagination in MySQL - offset vs. cursor
13:20
Просмотров 57 тыс.
Faster than a regular database index
13:39
Просмотров 19 тыс.
ChatGPT for Data Analytics: Full Course
3:35:30
Просмотров 254 тыс.
Offline-first, multiplayer SQLite
1:21:25
Просмотров 11 тыс.