Тёмный

How “lru_cache” Can Make Your Functions Over 100X FASTER In Python 

Indently
Подписаться 213 тыс.
Просмотров 20 тыс.
50% 1

Опубликовано:

 

2 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 63   
@AlexCernat
@AlexCernat Год назад
you should also specify that the cache works with pure functions; if a function has side effects and those effects are "needed", then the cache will break the functionality
@vorpal22
@vorpal22 Год назад
I was just going to say that one of the best examples to show the usefulness of caching here is fibonacci numbers, but I'm glad that you went through that.
@sadhappy8860
@sadhappy8860 Год назад
Interesting! I can think of some uses for this already. Especially for some math functions
@darrenlefcoe
@darrenlefcoe Год назад
I make python coding videos, so feel that I am (partly) qualified to tell you that you produce excellent videos. You type hint python so well, that you should consider moving to a statically typed language !
@Indently
@Indently Год назад
Thanks mate! I've jumped back and forth a lot with statically typed languages, and I still love the freedom you get with Python, even if type hints are not enforced. Maybe someday I will go back to something statically typed (I've heard mojo was something new and hot).
@darrenlefcoe
@darrenlefcoe Год назад
@Indently you are welcome. Your expression of the language is the best I have seen (and I have watched thousands of hours from many good youtubers)... There is typescript, but I don't know if the community likes it sufficiently. Anyway, good work, so keep it up.
@cheesy_boya
@cheesy_boya Год назад
Thanks for the guides, man. They've helped me a lot in my projects. Hope you'll keep on making them!
@samable9585
@samable9585 3 месяца назад
Key is same input should result same output. Do not use random, time, uuid, sequence etc …. Deterministic functions in oracle
@starmscloud
@starmscloud Год назад
Your explanation is always fantastic.. one question - from where to get list of libraries available in python ?
@david21289
@david21289 Год назад
PyPi
@manolomonetha8238
@manolomonetha8238 Год назад
Keep in mind that using caching might be opening pandora's box. There are several cache management issues that can occur...
@higiniofuentes2551
@higiniofuentes2551 18 дней назад
Thank you for this very useful video!
@higiniofuentes2551
@higiniofuentes2551 18 дней назад
These imports needs to be installed first? Thank you!
@KnightAmine
@KnightAmine Год назад
Thank you! But will this not be on the expense of the storage? If there is like an infinity of diffrent possibilities will that not cause any memory problems? 🤓 What are the actual limits? And when is Iru_cache best used or when to avoid it? (a SQL based function?) Can we save/load the cache so it is there if the script is newly started?
@duerdum9
@duerdum9 Год назад
It can grow without limit, which eventually will cause issues. You can clear it manually with cache_clear(). lru_cache doesn't in itself support save/load. LRU is best used, when you want to cache last used computations, and the previous computations is often used for (near) future computations (hence the name, least recently used cache). If your limit is very large, you can also use it for complex or long running computations, that have a high likelihood of repeating itself. This can also be useful, if you spend a lot of time doing external (e.g. API) calls that have a high likelihood of repeating. LRU is a "one size fits all", it's not always the fastest, but it is simple. The usecase isn't massive. But when you can use it, it can often be an extreme performance boost.
@Pawlo370
@Pawlo370 Год назад
Yay
@rugmaable
@rugmaable 8 месяцев назад
great. Now I see how my code will be running faster. I can already see a use for this. OMG python now just got better.
@CallousCoder
@CallousCoder Год назад
Nice speed up 😮and nice and simple. But something can’t ever get infinitely faster, though 😊There’s this pesky thing called physical boundaries in our universe 😅
@Indently
@Indently Год назад
My ignorance has no physical boundries 😎
@CallousCoder
@CallousCoder Год назад
@@Indently 😁same here, I tried to patent my ignorance but someone smarter than beat me to it already 😂
@gauravsoni4025
@gauravsoni4025 Год назад
Fibonacci example was amazing one to demonstrate this module, love it. ❤ 😎👌🏻 😄🕶️👌🏻
@haisomeone2218
@haisomeone2218 Год назад
First viewer and first like . Love the video . Well I've been doing python for 5 years and i know lru cache. But good one.
@brhoom.h
@brhoom.h 8 месяцев назад
is it necessary to clear the cash in some point!? and why!?
@MehdiRouanSerik7
@MehdiRouanSerik7 Год назад
My python version doesn't contain tools with measure function. Is it tools library or a your own one?
@tannaprasanthkumar9119
@tannaprasanthkumar9119 Год назад
How you are imported measure and you can share with that
@vincentlaizer
@vincentlaizer Год назад
hands down! the fibonacci example literally blew my mind, great video
@123FireSnake
@123FireSnake Год назад
Making recusrive fibonacci viable, ansolutely disgusting :D
@Indently
@Indently Год назад
Don't lie, I know you love it 😉
@123FireSnake
@123FireSnake Год назад
@@Indently caching like this, absolutely :D But i go out of my way to avoid recursion. "Every recursive function can be turned into a normal function with a loop" is all i ever needed to hear on recursion. That being said i don't know how bad recursion is in Python but my background is in Java and unless you want an out of memory exception because the call stack is too big you don't do recursion :D
@tycodj
@tycodj Год назад
​@@123FireSnake tail call optimization can fix that!
@duerdum9
@duerdum9 Год назад
@@123FireSnake Python has a default limit of 1000 recursions. It's to prevent accidental DoS. You can however increase this limit with a single function call.
@vytah
@vytah Год назад
​@@tycodjFibonacci does not end with a tail call
@NoidoDev
@NoidoDev 11 месяцев назад
The highest Fibonachi number which has ever been calculated seems to be the 150,000th number in the sequence, if chatGPT isn't lying.
@JuniorMenezes7
@JuniorMenezes7 Год назад
Damn!!! That's a huge improvement.
@makadi86
@makadi86 7 месяцев назад
can we use two decorator for the same function like @lru_cash and @staticmethod
@SkyFly19853
@SkyFly19853 Год назад
Super useful for video game development.
@config2000
@config2000 Год назад
I am completely stuck with the "from tools import measure". Cannot import measure from tools. I have the tools package downloaded but there is no measure package there?
@Indently
@Indently Год назад
I said I created it, no one can import my implementation 😅
@config2000
@config2000 Год назад
@@Indently That is really terrible in my view. You should at least write this in the python comment code instead of rushing through the voice comment on this particular important point. I hope you can consider my viewpoint here. Yes, this may be strongly worded but I do like what you contribute in general (hence why I am subscribed).
@Indently
@Indently Год назад
It's not an important point, all it does is time the code as I mentioned.
@akhileshchaurasia7966
@akhileshchaurasia7966 11 месяцев назад
@@IndentlyI guess u used perf_counter function and used (end time- starttime) to measure actual time of performing a function
@electricz3045
@electricz3045 4 месяца назад
​​@@akhileshchaurasia7966There is Not much to guess, He literally Said that He used pref Count... You should Watch the Video before asking questions...
@ricgondo
@ricgondo Год назад
Nice!
@farzadmf
@farzadmf Год назад
I'm really curious to know where the cache is "physically" stored? I'm guessing it should be stored somewhere by the runtime
@aflous
@aflous Год назад
it is just a simple python hash table stored in RAM
@farzadmf
@farzadmf Год назад
Right, makes sense
@날개달린_양
@날개달린_양 Год назад
is it dynamic programming?
@vorpal22
@vorpal22 Год назад
Caching is one technique that is used commonly in dynamic programming, but there are others... so it isn't equivalent to dynamic programming, but it's a very useful tool to implement dynamic programming when you can do so.
@EXATUBE
@EXATUBE Год назад
will help me make money
@fengjeremy7878
@fengjeremy7878 Год назад
Could you please share the code with us? It would definitely help! Thank you!
@mr.technoid
@mr.technoid Год назад
Worst thing of all time is recursion because it makes code length shorter but problem is at the same time it makes program a lot slower.
@vorpal22
@vorpal22 Год назад
"Worst thing of all time is recursion..." It's actually incredibly handy, and if you're doing functional programming, which is increasing in popularity for many reasons, there are no loops: recursion IS your looping technique. Making your function tail-recursive (which you can almost always do via techniques like accumulators, continuation-passing, or state monads) mitigates most of this by reusing the stack frame.
@mr.technoid
@mr.technoid Год назад
@@vorpal22 Doesn't matter what ever you say truth is code become slower a lot.
@vorpal22
@vorpal22 Год назад
@@mr.technoidIn a compiled language, tail-call optimization often translates recursive code to the same or a very similar instruction set in assembly code that using a loop does. If what you're working on needs to be speedy, you probably won't be using Python anyway, unless you're just piecing together libraries that are implemented in C, like numpy and many of the ML libraries, and then you're not not going to be particularly concerned with functional programming. (Python support for FP isn't great.) That being said, functional programming is gaining popularity quite quickly. Even non-FP languages are integrating a lot of FP constructs (e.g. Java and C++). If you're working with pure FP, you would never use a loop. In languages like Haskell, there isn't even support for loops: you'd be using functions like map, filter, foldLeft, foldRight, etc. or if you needed to write an ADT, you'd implement it and its typeclass instances using recursion. If you're not familiar with FP, I'd highly recommend you familiarize yourself with it at least a bit: it's a really interesting and different way of doing things that deviates substantially from OOP and imperative paradigms, and has a lot of advantages. The concepts are harder to understand, but there's a lot of really cool elegance there building programs with referential transparency and pure functions, and capturing side effects in monads. Research shows that code written in FP is less error prone, and in a language like Haskell, if your code compiles, it's highly likely that it isn't going to contain runtime errors. On top of that, it's overdramatic to say "worst thing of all time is recursion..." because there are plenty of things "worse" than recursion.
@8starsAND
@8starsAND 6 месяцев назад
2025 -> Python „programmers” discovered caching XDDD
@Indently
@Indently 6 месяцев назад
My man commenting from the future in 2025
Далее
10 Crazy Python Operators That I Rarely Use
11:37
Просмотров 21 тыс.
I Took An iPhone 16 From A POSTER! 😱📱 #shorts
00:18
5 More Useful F-String Tricks In Python
9:38
Просмотров 49 тыс.
Compiled Python is FAST
12:57
Просмотров 111 тыс.
5 Good Python Habits
17:35
Просмотров 546 тыс.
Please Master These 10 Python Functions…
22:17
Просмотров 168 тыс.
25 nooby Python habits you need to ditch
9:12
Просмотров 1,8 млн
Learn Python OOP in under 20 Minutes
18:32
Просмотров 43 тыс.
Being Competent With Coding Is More Fun
11:13
Просмотров 86 тыс.
How To Write Better Functions In Python
14:17
Просмотров 28 тыс.
10 Python Comprehensions You SHOULD Be Using
21:35
Просмотров 149 тыс.