Тёмный

Decrusting the tokio crate 

Jon Gjengset
Подписаться 82 тыс.
Просмотров 49 тыс.
50% 1

In this stream, we peeled back the crust on the tokio crate - github.com/tokio-rs/tokio/ - and explored its interface, structure, and mechanisms. We talked about blocking, cancellation, spawning, and mechanisms for synchronization. We also dug into some of what goes on under the hood where that ends up being relevant to you as an application author!
For more details about tokio, see docs.rs/tokio/.
Discord: discord.jonhoo.eu
0:00:00 Introduction
0:02:28 The parts of tokio
0:05:19 The tokio runtime
0:29:08 Blocking
0:48:09 Send bounds and LocalSet
0:51:04 tokio vs std Mutex
0:56:53 Runtime questions
1:06:00 tokio resources
1:28:19 tokio::fs nuances
1:33:47 tokio::process nuances
1:36:27 tokio::io things
1:47:30 tokio-stream
1:56:13 tokio::sync
2:11:10 tokio::task::JoinSet
2:19:13 tokio::select! and cancellation
2:51:26 tokio-util and CancellationToken
3:03:35 common errors: tokio::spawn
3:07:25 common errors: concurrency vs parallelism
3:08:53 common errors: mpsc fan-in
3:12:08 Follow-up questions and outro
Live version with chat: ru-vid.comYlTyZvpaywQ

Наука

Опубликовано:

 

6 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 52   
@brendanwenzel
@brendanwenzel 2 месяца назад
Dude, the level of depth you go into is so far beyond anyone else in this space. Seriously, you're an animal!
@0x1337feed
@0x1337feed 2 месяца назад
a Rustanean to be accurate
@volkan8583
@volkan8583 2 месяца назад
GOAT must be applicable here
@christsciple
@christsciple Месяц назад
I have been writing code since I was a wee little eleven year old boy, now going on almost 30 years and time and again I am humbled and learn new something new with each video of yours! These are truly gems Jon!
@felixcantournet
@felixcantournet 2 месяца назад
the tokio::pain!() (instead of pin) typo is just *chef_kiss*
@oof-software
@oof-software 2 месяца назад
The "Async in depth" entry in the tokio tutorials is also a really nice read! I didn't really understand the whole waker thing before reading that.
@sbx1720
@sbx1720 2 месяца назад
My dude delivered quality content again! Thank you sir. Please continue with the series.
@ahuggingsam
@ahuggingsam 17 дней назад
Love these streams! Could I also request a de crusting stream on the nom crate? That would be very helpful to me. Thanks for all you do either way!
@christopher8641
@christopher8641 2 месяца назад
As always, thank you so very much for putting the time into these videos. I've written tons of code with tokio and still managed to absorb some new thoughts and concepts. Maybe an idea for a future crust of rust might be an implementation of an async executor. Although, I'm not sure if it is a large endeavor, or a bit too deep in the weeds. I love that these videos are not step by step tutorials but rather a tutorial on how someone could arrive at an implementation. It's patterns instead of recipes.
@sagnikc395
@sagnikc395 2 месяца назад
thanks for this stream, just finished the riust book a few days back and wanted to learn about async programming in rust in depth . this is invaluable !!!
@loobersoog
@loobersoog 2 месяца назад
Another invaluable stream
@HangyuanLiu-mw5ud
@HangyuanLiu-mw5ud 2 месяца назад
I just started reading the chapter about asynchronous programming from your rust book. And this is the perfect companion to the reading.
@bobby9568
@bobby9568 2 месяца назад
Amazing Jon is at it again!
@rasoulmesghali
@rasoulmesghali 2 месяца назад
So excited to watch this brilliant video, thanks Jon
@burgerking4for410
@burgerking4for410 2 месяца назад
Just today I was thinking "Hmm, is there a 'Decrusting Tokio'?". Great!
@12e2aela7
@12e2aela7 2 месяца назад
Hi Jon, Thank you for your invaluable stream 🦀
@Fyyro
@Fyyro 2 месяца назад
Hey, excited to watch the video! You mentioned your discord server and said the link outloud but a link in the description you could click would be super nice!
@jonhoo
@jonhoo 2 месяца назад
Done!
@flyingsquirrel3271
@flyingsquirrel3271 2 месяца назад
That watch channel seems useful. In fact, after watching your video about channels, I implemented a sync version of exactly that idea (never published). It makes sense to just look into these modules to get to know the tools available. I guess I should do that more often :)
@leonie9248
@leonie9248 2 месяца назад
Yes!!! Thank you so much!
@rustprogrammer
@rustprogrammer 2 месяца назад
What an excellent video!
@navibongo9354
@navibongo9354 2 месяца назад
Godly video man!
@austinbelknap125
@austinbelknap125 Месяц назад
A helpful follow-on to this video would be the "tonic" crate, particularly how streaming RPCs work with tokio stream.
@user-hn1cy5ee5l
@user-hn1cy5ee5l Месяц назад
If I am not mistaken regarding select and why you can not pass future.await in select "arms" is that .await is simply instruction to await for the future and it should actually prevent from progressing the function body further. So that's why you need to pass a future and select will handle all of the "polling" tasks on it's own
@ridcully
@ridcully Месяц назад
Very helpful talk
@cappuccinopapi3038
@cappuccinopapi3038 2 месяца назад
Does anyone know if there's something similar to this channel for Golang? The quality of learning material for Rust is just extraordinary
@pratikkulkarni891
@pratikkulkarni891 2 месяца назад
Have you checked out Ultimate Go by William Kennedy? It's not a channel rather a course, but goes in pretty deep in the language.
@LB767
@LB767 2 месяца назад
Not sure I understood the difference between awaiting a bunch of futures in a LocalSet and just using a regular join! macro?
@NeronRVV
@NeronRVV Месяц назад
Could you explain or link to something that goes into detail on why Sink trait is not that great? My only guess is that encoding data is usually less error prone than decoding it, so additional trait on top of AsyncWrite might be redundant. Edit: should've waited for a few minutes before commenting
@user-hj3oh3to9j
@user-hj3oh3to9j Месяц назад
will you talk about pin trait in another crust of rust video? I think it's hard for me to understand = =
@drvanon
@drvanon Месяц назад
About notify-ing and moving to the runnable queue. If i were to only implement Future, how would the runtime figure out when to try polling?
@antonf.9278
@antonf.9278 Месяц назад
The poll method takes a context that contains a waker. This waker seems to come from the runtime and you are supposed to wake it to indicate that you are ready to be polled again. To call the waker you need to gain control of the CPU, this comes from the kernel (or the hardware directly if you run bare metal) and depends on the specific thing you are doing. If you call the kernel it should take a callback and without a kernel you need set a hardware interrupt.
@vimau010
@vimau010 2 месяца назад
Thanks!
@rajmajumdar5253
@rajmajumdar5253 2 месяца назад
Wow this is insane bro, really insane, nobody has gone to this much depth. Many thanks . Also can you tell me how you have the top bar of the firefox below? Also which fork of Firefox are you using?
@jonhoo
@jonhoo Месяц назад
Thanks! For setup-related things, see ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xmqpzpzdjI8.html :)
@luckystrike91
@luckystrike91 16 дней назад
why rust doesn't have push-based stream (rx)?
@bruceritchie7613
@bruceritchie7613 2 месяца назад
Til cargo expand .. among a bunch of other things! Thx!
@junhaozhu4763
@junhaozhu4763 2 месяца назад
How come you know so many details? I cannot find such resource elsewhere.
@christopher8641
@christopher8641 2 месяца назад
Experience, fork the code base, ask questions, make small but quality contributions, write a ton of code, read a ton of code
@tiagoneves7068
@tiagoneves7068 2 месяца назад
Que aula 🎉
@kylidboy
@kylidboy Месяц назад
best of the best
@yokebabjr3866
@yokebabjr3866 2 месяца назад
Why do we need AsyncRead/AsyncWrite in the first place? Couldn't they juste be a special case of Stream/Sink where the element is an u8?
@jonhoo
@jonhoo Месяц назад
They technically could, but that would be very very inefficient. There's generally overhead to every method call, even if it's usually fairly small, and incurring that for every single byte read or written would be too much for a lot of workloads.
@Lucs-ku5cb
@Lucs-ku5cb 2 месяца назад
Next "decrusting Iced crate"
@ACIB708
@ACIB708 2 месяца назад
holy shit!
@deanroddey2881
@deanroddey2881 2 месяца назад
It all sounded good until the whole mutex discussion. Obviously objects having mutexes always run the risk of helper methods recursively locking and other issues. But the number of gotchas required by async for these and other issues sort of undermines a major benefit of Rust which is it doesn't require every team member to be a veteran, human vigilance to avoid housekeeping issues, and minimizes spooky action at a distance. Those issues seem to undermine the potential simplification of using async a good bit in practical terms. I could see doing my own bespoke baby 'runtimes' for very specific scenarios, where the async'ness doesn't infect everything I guess, and where the complexity remains fairly low because it's not trying to be all things to all people.
@jonhoo
@jonhoo Месяц назад
Clippy actually already has a lint for catching using the wrong kind of mutex (rust-lang.github.io/rust-clippy/master/index.html#/await_holding_lock), and there's been an effort to get it into rustc itself (github.com/rust-lang/rust/issues/71072). You can also always _safely_ use the async version of the mutex, it's only if you try to use the sync version (to boost performance) that you have to be careful. Note further that using the sync version inside of sync code that is then called by async code is _also_ not a problem since sync code doesn't contain any awaits (by definition).
@noviriustomeisho6630
@noviriustomeisho6630 2 месяца назад
Can you turn this into a playlist instead of video annotations? It's very difficult to rewind when a sliver of the play bar is basically 10min
@jonhoo
@jonhoo 2 месяца назад
You should be able to go directly to each chapter either by clicking the timestamps in the video description, or by clicking the name of the chapter and then RU-vid will give you a full chapter list on the right just like how a playlist is shown :)
@deryilz
@deryilz 2 месяца назад
on desktop, you can also do ctrl with the right or left arrows to move to the start of chapters
@dominicfischer2891
@dominicfischer2891 Месяц назад
"I'm not gonna get too deep into How to write an asynchronous scheduler" 😿
Далее
Decrusting the tracing crate
2:57:25
Просмотров 43 тыс.
Crust of Rust: async/await
2:34:01
Просмотров 180 тыс.
ОВР Шоу: Глава Патриков @ovrshow_tnt
09:27
Crust of Rust: Atomics and Memory Ordering
2:39:20
Просмотров 79 тыс.
Async Rust Is A Bad Language | Prime Reacts
28:46
Просмотров 85 тыс.
Arc instead of Vec? | Prime Reacts
37:18
Просмотров 61 тыс.
Living with Rust Long-Term - Jon Gjengset
33:42
Просмотров 14 тыс.
Implementing (parts of) git from scratch in Rust
4:29:28
Two Ways To Do Dynamic Dispatch
19:54
Просмотров 69 тыс.
The Why, What, and How of Pinning in Rust
3:03:54
Просмотров 67 тыс.
Why Rust is NOT a Passing Fad...
8:54
Просмотров 26 тыс.
Crust of Rust: Send, Sync, and their implementors
1:07:04
Ноутбук БЕЗ ЭКРАНА!
0:54
Просмотров 55 тыс.
Неразбиваемый экран!
0:23
Просмотров 30 тыс.