Wow, this is immensely helpful. Thank you for an advance walkthrough of how to handle these data sets. I have completed all the coursework for this class, but feel lost doing the capstone at the moment.
I appreciate this a ton, for the trip durations with negatives, i figured out the issue was midnight, so i'm going to try and take the number + 60 and it should give the proper trip times.
Thanks for sharing this - I didn't know you could do so much within powerquery! I have a Q about the nulls or 0 values in the data, let's just say hypothetically the mgr doesn't know why these 0s exist or some values are null, is it good practice to delete these anomalies from the data?
I continue to go through this data, handing it in different ways such as SQL, Excel and R. While job hunting my R ability is limited at best, but hopefully it will make sense eventually. Thanks so much for doing so much work to show multiple ways to reach the end goal.
From what I have seen on RU-vid and other sources when starting out as an "entry-level" Data Anlytist you start working with SQL, Power BI (or Tabluea ), and Excel.
Hello again, I'm having trouble to restore the rows I want to keep after deleting the ones with 0 in trip_duration. Can you please help me? I'de also like to ask " do we work different when using Excell and Excell with Power Query? Thank you in advance.
this video has been extremely useful to me and liked how you talked about the missing values and duration less than 0, someone else here has said its because of midnight, it made me think how to think about cleanly data
Sir Thank you so much for sharing this video🙏 this is my first time learning, I have never built any portfolio before and I feel clueless about how to start. Until I found your video! Really helpful and I can learn how to clean real data. From this video, I know many tips and I can improve my skills as well. The next things I want to improve are my SQL, python, and R programming.
so incredibly helpful! honestly, it wasn't even so much the step by step that helped, because of course there are multiple way to come up with your own conclusions, but what helped me was even when you brought up the missing values in a column, or the "0 and less than or equal to 0". It really helped me think through how i could handle and clean my data in the future, and why i would look for such answers in the first place! very insightful, so thank you for that :)
Thanks for the kind words. Besure and Click , Subscribe, Like and Bell icons, and of course share the channel with friends who are interested in data analytics.
Hello, I use a non licenced Excell 2010 and I don't have the "get data from folder" choice .Because there is a limit of 1048576 rows I can't download all 12 months csv in the same spreadsheet, even if I've merged them into one file. Can you help me with this? Do I have to pay for Excell to get more options? Thank you.
Well the best answer is buy a copy of Excel 2016 or later. Apparently but can install Power Query as a add-on on 2010. Also look at my videos, where I had a databases.
Hi! Thank you for the amazing help! I'm using Mac, I'm trying to to close&load to a pivot table but do not have the option and just clicking close&load seems to be unable to load. Do you know any way around this?
Hello thanks for your time and effort put into making this informative video. This explanation helped me a lot, I was wondering if there is a part 2 to this video? And if so can you provide me with the name/link to it please. Thanx again I really appreciate it.
I am struggling to add days of the week. It keeps giving me days of the week from 0-6 instead of 1-7. Using power query. Any suggestions as to how I can do this?
Here is a video that shows how to what you are looking for . the Power Query show work the same for both PBI and excel: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-QFADxSyXwwY.html
Rather than import all 4M rows, use the group_by function under Transform, create summary tables, and then use them for your connections. BTW, I will be doing a live stream this evening at 8:00 PM/EDT. Click on the "Bell" Icon and you will notified when I go live.
yah, I'm really curious about this as well! when working with the pivot tables, when i place the "start_date" into the rows section, I get completely different output@@CaribouDataScience
@@naveenvasanth9306 Be sure and click both the "Like" and "Bell" icons, that way you will be notified whern ever I go like or upload new content. www.kaggle.com/datasets/evangower/cyclistic-bike-share.
Very helpful! I'm just getting started. Can this be done with Google Sheets? So far it is taking forever to load files. Struggling to get the first two months uploaded. Thanks
Be sure and click the "Bell" icon so that will be notified whenever I go live or upload new content. I don't think sheets has a way to import and combine 12 csv files. Remember you can use what ever you want to use for the project i.e. Power BI, R, Python or Tableau. Also if you look at the Capstone Playlist you well see other methods beside just Excel.
@@CaribouDataScience Thanks! I'm aware. I was trying with R but it's a bigger learning curve, although it's more efficient. I'm also trying with Numbers on Mac and surprsingly the files are uploading but it is taking time. I will research a bit more! I appreciate your help!!
@@CaribouDataScience Now I get, i tried finding the options on my device but couldn't spot one, just went through the comment and saw the video link you dropped. Thanks so much Sir, I really do appreciate your work here
BTW, I will be a live stream this evening at 8:00PM /EST (New York time) here is the link for that: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-sTcF4qAi-x8.html
@@CaribouDataScience Having errors after the abs function. I've gone back to watch the video over and over, can't seem to figure out where the error is coming from.
Hi sir, So I can’t get power query on my MacBook Pro because it’s an old version of mac. Can process all this data on google sheets instead? Thank you!
I'm just starting my capstone project and have attempted to import all the .csv files just as you did in this video, but my "get data" menu does not have a "from file" < "from folder" option available. There is only a "get data (power query)" option, along with a few others: "from HTML", "from text (legacy)", "from sql server", and "from database". When I click on "get data(power query)", it takes me to two more options: "import data from a MS Excel workbook" or " import data from a text or csv file." When I choose "import data from a text or csv file" it doesn't allow me to choose the correct folder. Instead, it opens the folder and only allows me to choose 1 of the 12 csv files. How do I import all these files into one excel sheet in the newer version of excel?? Sorry for the wordy question. I just wanted to be thorough in my explanation. I'll appreciate any help you can give me.
@@Fadein1980 You don't !! you use Power Query to import, combine, clean, and store the data to store the data. Note: PQ doesn't store the data in the spreadsheet.
