Python Generators Explained

Подписаться 1,5 млн

Просмотров 143 тыс.

50% 1

Welcome back to another RU-vid video! In this video, I will be talking about generators in Python. Generators are similar to iterators but a more advanced concept in the Python language. However, they are not too complicated and anyone should be able to follow along.
💻 Thanks to HiCounselor for sponsoring this video! Apply to their next cohort to land your dream job in tech here: hicounselor.com/ HiCounsoler not only provides great learning resources but also has great interview prep material!
⭐️ Timestamps ⭐️
00:00 | Overview
01:43 | Generators vs Iterators
02:40 | Iterators Explained
08:33 | next()
13:58 | iter()
15:24 | Creating Legacy Iterators
19:22 | Creating Generators
23:15 | Generators Use Case
26:58 | Generator Comprehensions
◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️
💰 Courses & Merch 💰
💻 The Fundamentals of Programming w/ Python: tech-with-tim.teachable.com/p...
👕 Merchandise: teespring.com/stores/tech-wit...
🔗 Social Medias 🔗
📸 Instagram: / tech_with_tim
📱 Twitter: / techwithtimm
⭐ Discord: / discord
📝 LinkedIn: / tim-ruscica-82631b179
🌎 Website: techwithtim.net
📂 GitHub: github.com/techwithtim
🔊 Podcast: anchor.fm/tech-with-tim
🎬 My RU-vid Gear 🎬
🎥 Main Camera (EOS Canon 90D): amzn.to/3cY23y9
🎥 Secondary Camera (Panasonic Lumix G7): amzn.to/3fl2iEV
📹 Main Lens (EFS 24mm f/2.8): amzn.to/2Yuol5r
🕹 Tripod: amzn.to/3hpSprv
🎤 Main Microphone (Rode NT1): amzn.to/2HrZxXc
🎤 Secondary Microphone (Synco Wireless Lapel System): amzn.to/3e07Swl
🎤 Third Microphone (Rode NTG4+): amzn.to/3oi0v8Z
☀️ Lights: amzn.to/2ApeiXr
⌨ Keyboard (Daskeyboard 4Q): amzn.to/2YpN5vm
🖱 Mouse (Logitech MX Master): amzn.to/2HsmRDN
📸 Webcam (Logitech 1080p Pro): amzn.to/2B2IXcQ
📢 Speaker (Beats Pill): amzn.to/2XYc5ef
🎧 Headphones (Bose Quiet Comfort 35): amzn.to/2MWbl3e
🌞 Lamp (BenQ E-reading Lamp): amzn.to/3e0UCr8
🌞 Secondary Lamp (BenQ Screenbar Plus): amzn.to/30Dtafi
💻 Monitor (BenQ EX2780Q): amzn.to/2HsmUPZ
💻 Monitor (LG Ultrawide 34WN750): amzn.to/3dSD7tS
🎙 Mic Boom Arm (Rode PSA 1): amzn.to/30EZw9m
🎚 Audio Interface (Focusrite Scarlet 4i4): amzn.to/2TjXsih
💸 Donations 💸
💵 One-Time Donations: www.paypal.com/donate?hosted_...
💰 Patreon: / techwithtim
◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️◼️
⭐️ Tags ⭐️
- Tech With Tim
- Generators
- Generators Explained
- Iterators
- Python
- HiCounselor
⭐️ Hashtags ⭐️
#TechWithTim #Generators1

Опубликовано:

2 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 172

@goboy6882 2 года назад

I started programming 60 years ago. Thank you Tim for teaching an old dog new tricks.

@Ian-bb7vv 2 года назад

wow, life long learning!!!

@piadas804 2 года назад

Wow

@JasonJorgensonPhD 2 года назад

What was it you were learning 60 years ago? Was it COBOL? Fortran? I started programming in 1980/81 but it was BASIC by then, and I graduated to COBOL and Fortran, eventually settled on C++ as my go-to language.

@me-zu3gm Год назад

Lies!🥱🥱🥱

@thelavagod Год назад

@@me-zu3gm how u know😂

@williamselinder9138 4 месяца назад

I very rarely leave comments on tutorials, but this was so incredibly well and robustly explained that I seriously need to leave my comment of appreciation, it was so clear to understand!

@Factory400 2 года назад

It is nice and refreshing to see a presentation of the back-end logic to the magic functions we have in Python. As much as I love the built-in functions - I really love knowing how they do what they do.

@harshraj22_ 2 года назад

could have added example of "yield from" as well. A great coding exercise would be, print inorder traversal of binary tree using generators.

@TechWithTim 2 года назад

Great idea!

@xx-jk1iq 2 года назад

ok please explain what "inorder traversal of binary tree" is

@gregfrost8399 2 года назад

@@xx-jk1iq Traversing a tree is just the order in which you access it's nodes. In-order traversal of a binary tree means you visit the left branch, then the current node, and then the right branch. Basically put it visits the nodes in ascending order.

@xx-jk1iq 2 года назад

@@gregfrost8399 but from what I thought, a binary tree isn't a linear sequence. So how would that work

@gregfrost8399 2 года назад

@@xx-jk1iq Say we have the following tree: A / \ B C / \ D E In order traversal does the following: 1. searches the left branch until it finds a leaf node 2. visits (e.g. prints) the current node 3. searches the right branch until it finds a leaf node Once it has completed the 3 steps it will return upwards to it's parent node The result = (D, B, E, A, C)

@gustavocinci4044 2 года назад

Thanks Tim. You have become the go-to guy when I learn stuff and get stuck. your explanations are very practical. as a new programmer who's attempting to beef up my resume, I have been teaching myself python. you have been a great resource, keep it up. THANK YOU!

@tyrelllaszlo6024 2 года назад

Great video and explanation! Was going to look for “how to process large amounts of data”, but clicked on this instead. Turned out to be the core of the answer👍

@michapodlaszuk9025 2 года назад

good stuff Tim, there's never enough of knowledge about python

@AleVZero 2 года назад

This channel is just so incredible! i can't tell how much i learned from this channel, thank you

@vinni113 2 года назад

i watched this video just to learn something new about python, turns out the generator is really applicable in my code and has helped memory usage heaps. Thanks!

@LNMLucasMasiero 2 года назад

Thanks you. This was really interesting. It's crazy how the most someone knows about how something works, then for intuition you can understand other stuff or libraries created from others. One of the usefully methods I use as a fast document of a library is "dir"

@NabeelButt 2 года назад

Good thing about this video is that it walks you through other concepts too such as class and dunder methods which is kind of a good refresher to what I have studied earlier. You've earned a subscriber Tim!

@saishyam8583 2 года назад

I would love to see a video on how you record and edit your videos Man This is some real good quality content!!

@Mr_Spock512 2 года назад

Indeed it is, I've learned a ton of stuff from him about Python.

@STFU665 Год назад

Really appreciate your videos. Thank's for sharing your knowledge. I'm just at the start with Python deep-diving, but already it keeps getting me staying awake at night. So many possibilities :D Keep on the good work

@CaratacusAD Год назад

This was an awesome video Tim. I'm learning about Deep Learning and generators have been particularly useful for chunking up huge datasets for feature extraction as it would be impossible to read them all into memory on my laptop. Now I understand how and why this works as a Python newbie. The explanation on Iterators was great too. I love the nuts-and-bolts detail on what’s going on under the hood. Many thanks.

@TheRealKitWalker Год назад

Wow! This was so refreshing and highly insightful. Thanks so much Tim for this really helpful video on generators. It helped me a lot understand this better!

@ChromaDotNova 2 года назад

I appreciate the video, Tim! I have a much better understanding of Python generators now.

@enzovalendino606 2 года назад

Hi Tim, you keep providing us useful contents: I'm glad for everything you've been doing! I'm truly interested in CS, and curious about how much of these information you have learned at university or on your own. Could you please answer me?

@fredericoamigo 2 года назад

Great video! Best explanation I’ve seen so far on this topic!

@ddbarenco 2 года назад

Amazing explanation! Learn a lot from it. Thank you soo much!!

@abdullahmohammed6115 2 года назад

Love your vids! Great as always!

@anirbanc88 2 года назад

i love your videos man, and your clarity of explanations, carry on!

@MissingTricks Год назад

This video provides a clear image of how it works. Thank you.

@rodrigo2112- Год назад

You're a great teacher, congrats!

@gustavojuantorena 2 года назад

This video has so much value! Thank you

@network_noob 2 года назад

Now i can finally understand generators! Thanks Tim!!

@bipolarchemist 2 года назад

For a deeper dive into generators, you can go into how you can use .send to update process parameters that may not have been relevant when initially creating the object. This was an area that originally stumped me when I was looking at some more advanced examples of generators as the function took in one set of parameters, but the subsequent calls with yield accepted different parameters. A very neat trick and one of the reasons why I find myself growing more enamored with the language.

@lepidoptera9337 Год назад

One can update objects at any time with a call to an object method just like one can update the value in a loop variable with a simple assignment. Writing a loop and an assignment makes the code readable for absolutely everybody with even the slightest amount of knowledge about procedural programming languages. Using send() will make 99% of programmers scratch their heads (including the ones who know what it does) and ask what kind of idiot will use such a construct. Guess who they mean by "idiot". They mean you. And that, by the way, includes yourself. You will call yourself an idiot for using this construct the first time you have to read your own code six months later. Simple is beautiful. Keep it simple.

@omarelsebaey9589 2 года назад

the example for the generator is perfect , thanks!!!

@ChandanSingh-bh7wu 2 года назад

******BEST GENERATOR EXPLAINATION********** read 3 books + 4 online tutorials, still confused about Generators******* Finally, got it ............!!!! Awesome Brother !!!!!

@onlyforscience8255 2 года назад

I learned new things which don't know anything about that. Thanks to make such a nice video for us. ☺️☺️👏👏

@parvishrao6414 2 года назад

Tons thanks, only video which clearly said what is iterator and generator - CRYSTAL CLEAR.

@manishsingh900 2 года назад

It really is a great video. Thank you!!!!. One of the best generators video generated🙂.

@vammy55 2 года назад

Great stuff mate,thank you and cheers!

@eddywang5035 2 года назад

Useful tutorial for me. Thanks.

@Barejs 2 года назад

awesome content, keep up with these videos Tim

@davidring5071 Месяц назад

Amazing video Tim. Thank you

@NearLWatson Год назад

Great job breaking it down 👍🏼

@estebangarro7254 Год назад

Excellent Video, thanks!

@Mdroudian 2 года назад

Great video. You have a good format. Don't change it =)

@danielmarx3106 2 года назад

You can use ctrl + d to copy a line to the next line without copy pasting in pycharm, not sure if something like that in sublime.

@elitearmedforce 2 года назад

Wow, really well explained, good that stumbled upon this. If u can do the same with other python(decorators...) and c++ concepts like this, pls. Subbed and liked,

@amalkrishnas1696 Год назад

Thanks for the video, well explained

@berkaybb5733 2 года назад

Could you make a video about Web scraping by using requests and beautifulsoup modules?And maybe some decorators would be great : )

@boooringlearning 2 года назад

thats brilliant video!

@johnnytoobad7785 2 года назад

Looking forward to "Learning Cobol with Tim" course !

@antmitchell9930 2 года назад

You should put the 'Pause 1' before the 'yield 1', I suspect, otherwise the pause text appears on the next call, not the one it refers to. Just learning Python - this is great.

@whatdoiputhere5089 2 года назад

yeah, he should've done that so everyone can know when is the 'Pause 1' getting printed

@user-zb8tq5pr4x 2 года назад

but the execution pauses after the yield, so pause 1 before makes no sense.

@aryankathawale9269 2 года назад

lets goo new tech with tim

@haneulkim4902 10 месяцев назад

Thanks Tim. One question. So creating generator don't even take up disk space? Say I have a for-loop that downloads a file, yield data, then delete the file where end result is a generator. This won't take up disk space and only memory upon calling __next__()?

@yoyokoko5153 2 года назад

Thanks for the good stuff

@grantpeterson2524 Год назад

How does a for loop work on an object that is already an iterator, like map() function you showed? Does Python implicitly know if the .__iter__() method needs to be called, or if it doesn't?

@JaBoss397 Год назад

Thank you !!

@alexandruteodor3585 6 месяцев назад

Thank you!

@rekhasurya3536 2 года назад

Love your Vids Tim! keep up the good work(hope u heart this!)

@nicholas_obert 2 года назад

Could you make a video on C extensions for Python? It took a while for me to learn as there aren't many resoruces out there and the documentation is partially outdated, but the speed increase using such extensions is exponential with regards to input size. I think a tutorial on this topic would prove highly useful to newcomers. I've already written an article about them on Medium, but I think you, Tim, can do a much better job at explaining them.

@hossumquat 2 года назад

Yes, this would be nice. Does Tim know C though? If so, I've love to learn how to integrate C and Python

@nicholas_obert 2 года назад

@@hossumquat he has made a series about C++, plus C is very easy at a beginner level.

@hossumquat 2 года назад

@@nicholas_obert Ah, ok, didn't know that. I'd guess he already knows this then and could teach it. Awesome!

@thaimeuu 5 месяцев назад

thank you, Tim

@korkunctheterrible4302 2 года назад

09:46 and on: Hi I'm a total noob and I don't get why for loop is able to pick the iteration up from where the last next call left it. why does the for loop know what happens before it? Is where next stops also stored and the loop preprogrammed to check that address? I'm sorry if I've misused words, I just don't know how else to ask about it. Any tip would be much appreciated. Also thanks to the maker of this video.

@bradyb2415 9 месяцев назад

First time i understood what you are saying....☺

@alexramirez5104 2 года назад

Damn I love this channel

@servantofourlordjesuschris6456 9 месяцев назад

Thanks!

@UgochukwuEzeani-ut6vd 5 месяцев назад

Awesome 🎉

@Tussu17 2 года назад

Thank you genius!

@wubangzheng 2 года назад

hi i wonder any python seniors could answer my question , i just started learning python and the things i learned included all the basics (i assumed) (exp:file handling,oop,the basic commands,if,loop,tuple,dict.....).Besides,i also learned some algorithms like linked list,binary tree,stack&push.For now ,what should i do in the next step?

@wubangzheng 2 года назад

i did some python projects as well like creating a simple alien invasion game

@Plepple 2 года назад

I'm not a senior, but I think working on projects is the best way. Do webscraping with selenium, API calls with requests, build a small website with django, use pandas to work with relational data, then improve all of the IO bound tasks with asyncio

@Kema109 10 месяцев назад

@14:40, if I would print(next(iter(x))) it would give me 1 thats true, but if I would do that again, I would get another 1 and so on. So it does not go to the next Element. That was kind of confusing to me. So I guess, you have to make the variable "x" an iter first, and then you can use the next(x) function to "jump" to the next element. Or did I not understand that right?

@robinferizi9073 2 года назад

I like how the first generator example is literally obscolete because you used for i in range: to say for i in range:

@mgmartin51 2 года назад

when i put the code at 7:29 into IDLE, (for i in y: print(i)), nothing happened. You got the list output. Why is that?

@georgianabhishek3561 2 года назад

Please make a pygame video explaining sprites

@jphvnet Год назад

If for loop stops by the exception, it's not clear where gen() raise the exception. Or there is a different logic inside for() .

@elpython3471 2 года назад

Hiyo tim! Good tutorial as always! Could you think about making more c++ content, and teach us about c++ libraries?

@innocentharelimana4449 2 месяца назад

we, we had teachers who didn't know these stuff😂😂😂, and graduated without this knowledge😊😊😊

@mufasaruleroftheanimalking1026 28 дней назад

It’s better to say next() consumes the list. If you printed the list y after invoking next() four times the console showed you the iterated elements don’t exist anymore in y.

@pabloshi4863 2 года назад

Could anyone help me of how to show the [Finished in X ms] in the console?

@lukaszno8988 2 года назад

Hi Tim can you explain interface in python?

@robinbreed2439 Год назад

super good

@UgochukwuEzeani-ut6vd 5 месяцев назад

Awesome

@mohamedelzend2337 2 года назад

what is that code editor tim using ?plzzzzzzz

@64imma Год назад

What text editor are you using?

@entity5678 Год назад

sublime text

@amrsalaheldinabdallahhammo663 Год назад

Thanks genius :)

@barbaraulitsky8292 2 года назад

This is a super tutorial! Super helpful and clear explanation! Tim, you are awesome! Thank you so much!!!

@SkyFly19853 2 года назад

Thanks for the explanation. Btw, are you interested in making a video about Cython ( C amd C++ extension on Python ) ? Thank you in advance!

@jonathan3488 2 года назад

Yep. I have tried using cython, but encountered IDE errors and performence issues.

@SkyFly19853 2 года назад

@@jonathan3488 I see... Even so, I think it has the potential.

@youssefelamrani7905 2 года назад

can you do a video about testing Tim, i heard spaceX is using Python for testing

@xx-jk1iq 2 года назад

what do you mean by testing?

@neerajvaradi8505 2 года назад

How your code showing the run time..?

@tcgvsocg1458 2 года назад

Can you create a "screen recorder"app on python please

@terryr5713 2 года назад

Tim what can I do with a computer science degree except programming!? 👍👉💪

@ncmathsadist Год назад

the object returned by open("foo.txt", "r") has an iterator that walks through the file a line at a time.

@lepidoptera9337 Год назад

That's too easy for the man. He needs to make things complicated. ;-)

@Aidanbaro Месяц назад

Hi Tim

@Jschmuck8987 3 месяца назад

After every explanation: “HOPEFULLY that KINDA makes sense”. Yes bro it makes sense ffs.

@belowasmelashgebremariam Год назад

Nice

@belowasmelashgebremariam Год назад

Asme Tchaikovsky climb to uucp

@belowasmelashgebremariam Год назад

Razed St Ed Sry egg re zed zarathustra ink

@stele339 Год назад

Хвала!

@ilyasseidkhebbach3812 Год назад

good

@avigupta6064 2 года назад

Tell me your theme and color of vs code pleaseeee🥺

@error2839 2 года назад

He’s not using vs

@avigupta6064 2 года назад

@error i know, i am just talking in general like that spotify api tutorial he did.

@laponiec 10 месяцев назад

Why would we want to implement our won iterators? Edit: So, we don't need to create iterators, because they have been replaced with generators?

@HarryBGamer2570 Год назад

what's that font (name?)

@aryankathawale9269 2 года назад

here before 8 comments

@malanbandara 2 года назад

This guy is almost like Mark Z.

@shawnbeans7389 2 года назад

tim finally decided to change from monokai

@comedyclub333 2 года назад

I think your comparison between the generator and "legacy" syntax is a bit unclear. The class based iterator seems way more inconvenient than it acutally is since you used "range" in the generator but implemented a range-like behavior from scratch in your class. When returning a range object in the _ _ iter _ _ method the class would not be that more bloated and actually useful depending on your use case. I think it could've been made more clear that a generator relies on existing iterators while the iterator class, well, does not since it is made to provide its own iterator.

@gagansai8880 2 года назад

generators need not rely on existing iterators... def upto(x): current = 0 while current

@comedyclub333 2 года назад

@@gagansai8880 Yeah, you are right. Totally forgot about the fact that for loops and while loops are interchangable. I wrote bullshit about generators relying on existing iterators. My criticism still remains that the way custom iterator classes and generators are compared is not really fair.

@korkunctheterrible4302 2 года назад

@@comedyclub333 I don't understand. Wasn't it said or implied in the vid somewhere that yield uses next() as a built in? (I am not a geek or anything, I truly don't understand and I am a 5 year old when it comes to this)

@memk 2 года назад

Ahh, you also forgot the send method of the generator. That might be it's own video tho as it's the base of coroutine

@WhiteDevil-yu5ry 2 года назад

Hoping For Tim! To give a heart to this comment! :)

@jammincoder 2 года назад

Those 2 thumbs-downers had their computers upside down.

@krishnaramasimha 2 года назад

8th

@ScOrPiOnE905 2 года назад

I'd like to make a note regarding the execution of generators, maybe somehow it'll be useful to someone. A generator will not re-iterate if it has already finished the range it was given in a variable for example. However, it will re-iterate if you call directly to the generator itself, not the variable you might have assigned it to. You can try this out with a range, a for loop and the print function (I've posted some code below to give an example) Code to try it out for yourselves below (I hope the formatting won't be broken): def generator_example(n: int): print(" Generator has started. ") start = 0 while start < n: print("Generator is returning {}".format(start)) yield start start += 1 range_example = generator_example(5) list_example = [] print(next(range_example)) # Exhausts 1 of the total of 5 values in the range_example variable. input("Press Enter to proceed.") for values in range_example: input() list_example.append(values) # Only 4 values remain to be appended. print() print("Generator has already finished and will not execute the for loop in the code in the same variable (range_example) below.") print("The print(next(range_example)) function will also exhaust one execution of the generator.") for i in range_example: list_example.append(i) print() print("Calling the function itself, however, will execute the for loop however many times you want.") print() for j in generator_example(5): list_example.append(j) for k in generator_example(5): # print(k) list_example.append(k)

@korkunctheterrible4302 2 года назад

So where is the information for the first next() yield stored, in range_example ? and if it is stored, why does that not take up memory or is it that it just takes smaller memory in comparison? when you call the generator_example function with the argument 5, does the function def block create 5 spots to fill for in the range_example first, and one gets filled by the first "next", and a mark is put in there? does the info for where the mark will go get overwritten in the same space of memory with each execution? lol sorry for my dreadful misuse of any term or anything and I hope you still understand my question (I actually asked about it before I bumped into your explanation, and YT doesn't let me copy any comment from other users, although I will try it out myself later when I'm able but there's a chance that I'll misinterpret somethings) Thank you for your comment btw.

@korkunctheterrible4302 2 года назад

Also what'd happen if there were no range_example to which to assign generator_example()? it would start from the start like at every call, like you said later in your post right? but I don't remember Tim using another alias like thing, still it picked up where next() left off (4 nexts and then for loop picks up the fifth, at 09:46)