Тёмный

How To Add LOGGING to Your Python Projects for Beginners 

John Watson Rooney
Подписаться 86 тыс.
Просмотров 34 тыс.
50% 1

As you scrape more and more sites and save more data its a good idea to learn the basics of logging for you Python files so you have a good understanding of whats going on, where its going on and any issues that come up. In this video I'll show you the simplest way to get some good logging for your web scrapers.
If you'd like to support me:
Patreon: / johnwatsonrooney (NEW)
Amazon UK: amzn.to/2OYuMwo
Hosting: Digital Ocean: m.do.co/c/c7c9...
Gear Used: jhnwr.com/gear/ (NEW)
-------------------------------------
Disclaimer: These are affiliate links and as an Amazon Associate I earn from qualifying purchases
-------------------------------------

Опубликовано:

 

29 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 42   
@june5646
@june5646 Год назад
This is a terrible beginner tutorial even if you know python!
@gitgosc7075
@gitgosc7075 2 года назад
super advice!
@adnanpramudio6109
@adnanpramudio6109 3 года назад
I didn't know logging like this would be really useful, thanks john!
@bidhanry9740
@bidhanry9740 День назад
❗❗❗❗ I have a doubt, suppose log code is written at line no. 27 Now suppose some error occurred at line no 42, then also the error at line 42 logs would be saved?
@miss_tech
@miss_tech 3 года назад
video suggestion : scraping Instagram user urls Who are liking a post 😁✌
@dp70737
@dp70737 Месяц назад
I used everything above def but my log file is always blank. It isn’t giving me details on each step like the video does. Has logging changed since 2 years ago? Seems like i would have to replace my print steps with logging() or logger() steps
@mayuriwagh3680
@mayuriwagh3680 17 дней назад
Plz answer I hv one doubt where have u written that message...u have written only message how does that line got printed in output ?
@apexlegendsclips1045
@apexlegendsclips1045 3 года назад
Thanks for this you actually created half the script I need, I just need to figure out how toopen each product in a window and scrap the title, description and images from each
@albievowles6417
@albievowles6417 Год назад
for beginners, yeah right, how the hell are we supposed to know what is where and how it knows what to do from a 6 minute video on an amazon website hacking thing, what the hell???
@apexlegendsclips1045
@apexlegendsclips1045 3 года назад
I am a total noob but I have this cool script idea if anyone would like to collabe
@rtxmax8223
@rtxmax8223 3 года назад
What can we do when the file output reaches a certain size and then we can write a new file. I used to see this kind of logging in my previous organization for their application server.
@waleedahmed1683
@waleedahmed1683 3 года назад
Very useful stuff you are teaching on your channel. Thanks a lot! Also do you have any best books to read about advance stuff in web scraping?
@SkySesshomaru
@SkySesshomaru 3 года назад
So simple, damn. You rock man.
@gskluzacek
@gskluzacek 5 месяцев назад
Don’t use logging basic config, don’t even tell people that it exists. 👎🏼
@dp70737
@dp70737 Месяц назад
Why?
@multigladiator384
@multigladiator384 Год назад
logs are so important. imagine having an application server running and some customer reports errors/something not working. Now with logs you can see what happened very easily and support, but with print statements this is not possible .
@multigladiator384
@multigladiator384 Год назад
you could make an admin area in your application and make the folder with log files existing on server side accessible there via the webgui (read,delete) - easily support your customers. you could also train customers to interpret those files themselves but keep in mind what insights you want to give them. minimize work on support, have more time for development of new features, grow, become rich
@praveennair1
@praveennair1 3 года назад
Loving your content mate
@PalataoArmy
@PalataoArmy Год назад
Working perfectly with python 3.9.13, log file contains all the error, info, later then using the exact same code with other working env using python 3.10.8 the log file is empty but console shows a lot of things. So what did i missed?
@carryminati4401
@carryminati4401 3 года назад
You are awesome bro it really helps
@bygracethroughfaith3213
@bygracethroughfaith3213 3 месяца назад
Thank you 🥰💕
@ameurchabane6001
@ameurchabane6001 3 года назад
Hi John, thank for all jour efort. I have question, how van i open many windows of chrome whene we use selenium like do login for many of the same script but such login in difrent window
@tnssajivasudevan1601
@tnssajivasudevan1601 3 года назад
Really useful. All The Best Sir
@Moist_yet_Crispy
@Moist_yet_Crispy 3 года назад
Absolutely loving your videos.
@mrvalvet9856
@mrvalvet9856 Год назад
Thank you, John!
@sheikhakbar2067
@sheikhakbar2067 2 года назад
What I like about your videos is that they start from the basic principle, and gradually evolve to the practical application, while keeping the video short!
@JohnWatsonRooney
@JohnWatsonRooney 2 года назад
Thanks!
@murarikumar9503
@murarikumar9503 Год назад
​@@JohnWatsonRooney please increase sound so that i can become more audible
@Wonderfull_Hasti
@Wonderfull_Hasti 10 месяцев назад
Exactly! Stop using print() was what attracted me and let me understand the benefit of logging :)
@tubelessHuma
@tubelessHuma 3 года назад
It is a very useful debugging tip. 👍🌹
@JohnWatsonRooney
@JohnWatsonRooney 3 года назад
Thank you 🙏
@Suresh_Solution
@Suresh_Solution 3 года назад
Which code editor is used for this tutorial
@JohnWatsonRooney
@JohnWatsonRooney 3 года назад
It’s PyCharm community edition (the free version)
@MakeTheFoxRush
@MakeTheFoxRush 3 года назад
very useful as always
@hariprasad-zq2bp
@hariprasad-zq2bp 3 года назад
Make vedio on scrapping interactive charts as the data is inside svg tags
@silkogelman
@silkogelman 2 года назад
Great intro to logging in Python. Thanks John!
@JohnWatsonRooney
@JohnWatsonRooney 2 года назад
Thanks for watching!
@gisleberge4363
@gisleberge4363 Год назад
Very useful. Thanks for putting it out.
@DittoRahmat
@DittoRahmat 2 года назад
If I want to use logging for scrapy, where do I put this code ? The spider file ?
@JohnWatsonRooney
@JohnWatsonRooney 2 года назад
Scrapy has its own logging built similar to this - it’s on my list of topics to cover!
@Suresh_Solution
@Suresh_Solution 3 года назад
Nice tutorial bro
@strawberriesandcum
@strawberriesandcum 3 года назад
How can I debug csv, one of my writers is working but the Seccond one in the Seccond file isn't, i checked there is no commas
Далее
This is How I Scrape 99% of Sites
18:27
Просмотров 86 тыс.
Python Logging - Tutorial
15:02
Просмотров 161 тыс.
▼ КАПИТАН НАШЁЛ НЕФТЬ В 🍑
33:40
Просмотров 346 тыс.
ПОЮ ВЖИВУЮ🎙
3:19:12
Просмотров 879 тыс.
Loguru - Simplified Python Logging with Loguru!
28:56
3 Python Projects I’d Put On MY Resume
14:49
Просмотров 67 тыс.
Want To Learn Web Scraping? Start HERE
10:54
Просмотров 27 тыс.
▼ КАПИТАН НАШЁЛ НЕФТЬ В 🍑
33:40
Просмотров 346 тыс.