Hey All, Welcome to my channel Sriw World of Coding. Hope you all find it useful.
Through this channel I tried to simplified learning and solve the challenges faced by students and professionals.I have made several playlist on Python, Azure, Docker, Shell, Talend, Jenkins , Leetcode questions ,Flutter and Terraform
Please support me by clicking LIKE and SUBSCRIBE button to be notified for new videos :)
Support me to create more videos : buymeacoffee.com/sriw
Say i have a dag run happening and i change the code changes in tasks without changing dag id. Will currently running dag run reflect new code ?? Sah the tasks involve importing a library and i update the library while the dag run is happening!
When a DAG run starts, it uses the code that was present at the time the DAG run was triggered. Any code changes made after the DAG run has started will only be picked up by future DAG runs, not the one currently in progress....
I bought your course on udemy for Airflow, great course but only thing thats missing is real world scenarios and examples, can you include them and also include some projects for data engineers, thanks
Thank you so much for purchasing my Udemy course on Airflow and for taking the time to provide feedback. I'm glad you enjoyed the course! I appreciate your suggestion about including real-world scenarios and examples. That's a great idea, and I'm currently working on updating the course with more practical examples and projects tailored specifically for data engineers. Your feedback helps me improve the content to better meet your needs. I'll keep you updated on when these additions will be available. In the meantime, feel free to reach out if you have any specific scenarios or projects you'd like to see covered, or if you have any other questions. Thanks again for your support....
Hello... Within dags folder u can create numerous folders and airflow scheduler will parse the dags... If u dont want to parse the folder u can use the .airflowignore file to prevent scheduler from parsing the folder Yes other scripts can be imported inside main dags scripts Let's say u are keeping temp.py inside common folder.. U can import using From common.temp import <function>
If u are still facing error while connecting to Postgres database using pgAdmin : Unable to connect to server. connection failed: FATAL: password authentication failed for user "postgres" connection to server at "127.0.0.1", port 5432 failed: FATAL: password authentication failed for user "postgres" 1. Open WSL and switch to postgres user using command : sudo -i -u postgres 2. Open psql shell using : psql 3.Update the password of postgres user using: \password postgres 4. Enter the password as postgres and retype the same password Now u will be able to connect Postgres database using pgAdmin
Unable to connect to server: cnnection failed: connection to server at 127.0.0.1, port 5432 failed: password authentification failed for user "postgres" .... I think it has a problem with my username but how can I know what would be my username? Thank you
Kindly follow the steps to setup connection to pgadmin in case of error : 1. Open WSL and switch to postgres user using command : sudo -i -u postgres 2. Open psql shell using : psql 3.Update the password of postgres user using: \password postgres 4. Enter the password as postgres and retype the same password Now u will be able to connect Postgres database using pgAdmin
psql server is not runnign actually in my wsl. and also im seeing some permission issues too "andrew@ANDREW-BLAZE:~$ sudo -u postgres psql -c 'SHOW config_file' could not change directory to "/home/andrew": Permission denied config_file ----------------------------------------- /etc/postgresql/14/main/postgresql.conf (1 row) ". finally in the pg admin it is saying unable to connect to the 127...... 5432.... password authentication failed can u help me?
U can start running psql using command : sudo systemctl start postgresql default password to connect with postgresql is "postgres" itself. Please let me know if u are still facing the issue .
Kindly follow the steps to setup connection to pgadmin in case of error : 1. Open WSL and switch to postgres user using command : sudo -i -u postgres 2. Open psql shell using : psql 3.Update the password of postgres user using: \password postgres 4. Enter the password as postgres and retype the same password Now u will be able to connect Postgres database using pgAdmin
If u are still facing error which connecting to Linux distro using Winscp : 1. First run command is WSL : sudo service ssh status If output of above command shows status inactive 2. Start Ssh service using command : sudo systemctl enable ssh 3. Enable Ssh service permanently using command : sudo systemctl enable ssh 4. If Despite starting the ssh service doest work , restart the ssh service using : sudo service ssh --full-restart
Hi Bhaiya, I need your help!! I receiving error message while implementing email operator to send me a mail(it is the last task of my dag) could you pls help me to fix. I am stuck at this point for more than a week now
ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xJrcExbQzKE.html Kindly have a look at this video to configure notification in case of task failrure. Kindly support by subscribing to my channel.
@@sriwworldofcoding hii thanks for responding. I have already fixed the issue. Coming back to your content, hv subscribed already. Keep going! Love your content
Hi I am getting this error while importing spark session - "ImportError: cannot import name 'MutableMapping' from 'collections' (C:\Users\user\anaconda3\Lib\collections\__init__.py)" cn you please suggest on this
