I hope everyone finds this useful. Going out and practicing with real-world data like this is one of the best (if not the best) way to practice your skills. If any of you do your own analysis that's interesting then be sure to share it with us in the comment section below! PS I forgot to mention that as usual, the code for this video can be found in the description section.
Corey, can you please do a video where you explain how to get to that level of intermediate-advanced developer where one can play with code really-really easily? In essence, say if one wants to learn about new library or framework or a new challenge - - can you please explain your process how do you go about actually learning that field rather than doing videos on standalone topics as IMO that would really help a lot of people to sorta move to the next level a lot. Thx
Finally, i understand analyzing Data in Python! I went from Coursera via EDX, UDEMY etc. But this.... this is a pure gold sir! Please, do some course or learning path for Data Science with Machine Learning in Python in depth( let it be if needed a paid learning path). You are one of the best! If you somehow manage to come in Macedonia, tell me, i want to bow before you!
Thanks! Im still working on a Pandas series. 4 videos are complete but I'm working to finish the rest soon. Glad to have you as a subscriber and member. You all make it possible for me to release these for free. Thanks again! media.giphy.com/media/WvUyMX1gB1gnC/giphy.gif
Man, you are awesome, you are the reason that I open RU-vid, please if you come to Japan one day, I will do my best to show you good places here in Tokyo.
In case anybody ran into an error like "UnicodeDecodeError: 'charmap' codec can't decode byte 0x81" while reading the csv file like I had, the fix is to add a encoding='utf-8' parameter to the with open() function. e.g. with open('survey_results_public.csv', encoding='utf-8') as f:
If anyone else is facing the UnicodeDecodeError try adding this second argument to the open function => with open('data/survey_results_public.csv', encoding="utf8")
Your videos are great and is probably the most easily understandable in all of youtube. Also, can you make videos about implementing AI in python cause there are not any good ones that meet your standard
Thanks Corey! I’ve been following your excellent tutorials for quite awhile. Just wanted to say that I’m excited and looking forward to your Pandas course(s).
Hey Corey, I have seen the previous videos on DataFrames with Pandas where you used Jupyter as well. You mentioned in this video that it is nice that you can run code brackets or just certain lines of code. My question would be then, what is the difference between Jupyter and Spyder? Since Spyder can also execute certain code lines, without loading everything in again and has a super awesome functionality where you have a variable manager in which you can view every variable you declared.
It didn't work somehow and I had to do a google search on my error: 'charmap' codec can't decode byte 0x81 in position 5739. So I had to change the with open part and specify the encoding part, after that everything worked fine. *with open('data/survey_results_public.csv', encoding='utf-8') as f:*
Your videos are so brilliant as I want to keep them to myself only... 💎 ...however, way too good not to share them with others. Shared with my classmates - hopefully, they find it useful :)
As hobbiest my first inclination would be to extract the data using pivot tables in libreoffice. Thank you for demonstrating the use of python for this purpose.
Hi Corey, how are you? i have been watching your series and videos, and think they are the very best out there, i really like to learn with you, I would like to ask you some things if you could solve them, when you make the matplotlib series, you separate the convertedcomp for all the devs and for the python dev and javascript dev, can you upload a video to solve it? I tried anyway and could not. ?
On inspection of the data. The csv.DictReader(f) throws 594 errors in the for loop >> line in csvReader: Not sure what causes the error, but this exists. Needs to be handled with try: except UnicodeDecodeError: who else sees this ?
Hi Corey! Love your videos man! I have finished your Flask series and currently doing the Django series. I have a few suggestions for future videos around the Blog Website that involve some ML and Data Science: 1. Introduce 'like and comment' functionality to the application which allows a user to comment and like posts by other users. 2. Then, integrate a recommendation system engine to the Blog application, the system will recommend content to the individual user based on his own posts and the posts that he has liked. 3. Also, a user can look into the profile of other users and see a word cloud of all posts that the other has submitted, this way they can get a rough idea of what the other uses posts. Keep Doing the good work man!
I mentioned the reason in the video. I wanted to show how to do this without Pandas first, and once I release my Pandas series then I will redo this video using Pandas as well. That way people who are unfamiliar with Pandas can do this as well
Your videos are awesome. I am new to Python and preparing for Python certification. Can you please let me know which one of the following programs are good to proceed? Thanks in advance. 1. PCAP: Programming Essentials in Python from Netacad 2. Microsoft 98-381 Introduction to Programming Using Python
Nice! What about a future video with some visualization of geospatial data? I.e. using some GPS tracks converted into CSV file with all points lat and long. Would you suggest to use postrgres or postgis to then make queries to the geodata?
If one day I decide to learn Python, then do I waste my time by learning C language now? I am learning C, primarily because I want to understand how memory works and DSA is easier to understand with C. Will this knowledge be helpful if I decide to learn Python? Seems like C and Python have a lot of differences, in Python there are so many things that I don't need to worry about. One more question, is it difficult to find out what is happening behind scenes in Python, for example: implementation of input() function? Great videos, the main reason why I am considering to learn Python.
Looking forward to seeing a future video where pandas is used to analyze this same data. Really appreciated your stepping through the thought process, something I haven't seen in many other data science tutorials. Approaches to data cleaning is another interesting topic that would be nice to see covered in a future video. Recently there were these FEC reports... :-)
You produce some of the best tutorials on python. Itd really help if you did one on advancing jupyter notebook use, and seeing up sublime to work with pandas.
Hi Corey, thank you for the content you put out, it is beyond exceptional. Also, it would be great if you could make an in-depth course on SpaCy, and its application in Data Science.
Finally a project not using either the Titanic or Iris datasets. Corey, you are a gem. Thanks for all the effort you put into this and every other tutorial.
i got this error: Yes Traceback (most recent call last): and it just shows me the first yes and no and in the end it says: return codecs.charmap_decode(input,self.errors,decoding_table)[0] UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 5739: character maps to
Its an encoding issue with the file, open a file by specifying proper encoding something like: with open('data/survey_results_public.csv', encoding='utf8')
for line in csvReader: failed on line 16. UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 5739: character maps to problem with the data-set or other reason ?
f anyone else is facing the UnicodeDecodeError try adding this second argument to the open function => with open('data/survey_results_public.csv', encoding="utf8") this is a comment i found by Jack Leone. you're welcome
Not necessarily. They can choose multiple languages. So for example, for front-end developers, most said they know JavaScript, but they also knew other languages as well. So each language is a percentage of how many developers said they know a particular language. Hope that clears it up
Dear Corey. I am finding your tutorials quite interesting but with respect to this one I feel disappointed. What you are showing is not a proper way to analyze any data because with significant effort comes quite basic results. I have expected you to show first of all the process of recoding the "verbal" data into numeric one (transforming the answer into numerical representation) than adding description layer (assigning labels to questions and answers) and only then star the proper data analysis including but not limited to: frequencies, crosstabulations, statistical tests, correlations and maybe even data clustering. I fully understand it is a long shot but I guess the impact on small series "How to proper analyze data in Python" would be much better that just one clip that shows something...rather not very usefull from the perspective of data science.
