As a marketer this is groundbreaking. I never came steps ahead of the basic interacting with a data frame. Now I can really learn and gain insights from giant data sets. Thanks for the video- very fact-based and not following the overall hype.
Computers understand Machine language so your need to create Software to convert Human language to Machine languages. This shows actually skills of programmers and developers.
This video deserves more views.... Horribly amazing how this can change the data analytics and data science job sector in the future..... Genuinely concerned😵😵😩
Indeed… only the best at the job will survive. Skills like mathematics may help us survive… Also note that, if things get complex, ChatGPT may be wrong (like in Python programming). Only the best skilled may spot its errors.
This wrecks most of my degree. I have a data specialization in a Computer Science degree. I’m just going to end up being a data farmer and janitor 😂 I’ve already got ChatGPT 4 building most of my dashboards (there are issues with depreciated features since 2021). This then lets me ask for the types of data analysis/visualization that I need and apply ctrl-C&V into my dashboard. Or someone could skip the dashboard if they only need a few calculations and the data is clean enough.
This indeed does look incredible. I have been using Langchain so far to 'analyse' information but Code Interpreter seems way faster and more intuitive. Just out of curiosity, how long were you on the waitlist before getting access to the plug-ins?
Ben your book is awesome, very thoughtful and original. Your insights into the the use and misuse of data will only become more relevant. I do hope to be able to follow your interpretations of how LLMs change data analysis. Thanks
7:00 the thing is while an LLM is possibly going to be wrong when working with training data and giving a response, when its working with information you specifically give it, I imagine its less likely.
Absolutely! And remember that writing code is for the AI like everyday language for us. After all our weird prompts and expression styles, when it gets to strict code, it goes, oh, yeah, finally we're talking, let me build this Python script for you! :) This showcase and technology will have great implications for our lives soon imo.
A tutorial on using the Code Interpreter Alpha plugin for Chat GPT to analyze data, using a CSV file of air traffic passenger statistics. [00:01](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT [02:33](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html53) Plugin infers column information and creates descriptive statistics and charts [05:11](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Modified bar chart showing top 10 operating airlines by passenger [08:00](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Combining and filtering data in Python and Tableau [10:44](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) The AI model can perform different types of analysis based on user input. [13:04](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Analyze data using NLP and Transformers with ease [15:40](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) New technology allows for conversational data analysis [17:53](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html073) Super intelligence on the planet raises concerns for human species --------------------------------- Detailed Summary for [Trying out Code Interpreter for ChatGPT](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) by [Merlin](merlin.foyer.work/) [00:01](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Using Code Interpreter Alpha plugin for data analysis in Chat GPT - Code Interpreter Alpha is an experimental model that can use Python and handles uploads and downloads - The plugin can be used to analyze data by uploading CSV files and using pandas data frames [02:33](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html53) Plugin infers column information and creates descriptive statistics and charts - Plugin guesses column metadata, which may be susceptible to error - Plugin creates bar charts, pie charts, and descriptive statistics [05:11](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Modified bar chart showing top 10 operating airlines by passenger - Data labels added to the ends of each bar with thousands separated - Passenger count verified with Tableau analysis [08:00](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Combining and filtering data in Python and Tableau - Python code combines data based on a condition and creates a bar chart - Tableau is used to filter the data by domestic flights and redo the bar chart [10:44](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) The AI model can perform different types of analysis based on user input. - Filtering data by Geo summary is possible for domestic flights. - The AI model can identify seasonal patterns and major outliers in passenger count data. [13:04](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) Analyze data using NLP and Transformers with ease - Create python code from everyday language to modify data, charts, and graphs - Output data as PDF with ease [15:40](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html) New technology allows for conversational data analysis - Technology is error-prone and requires careful cross-checking - Enables self-service data analysis for anyone [17:53](ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-b9hSCuFGNRU.html073) Super intelligence on the planet raises concerns for human species - Real conversations needed on how to handle this technology - Guardrails needed to be put in place quickly to avoid negative consequences
Thank you. Literally all the other videos about Code Interpreter don't bother to check the results. It's mind-blowing to see the chatbot be so accurate. Now I wonder if it can solve equations, make physics simulations... Also, there's something never mentioned in those experiments : the time the AI takes to do the tasks. It takes much longer to ask ChatGPT to interprete this data than to do it yourself, lol. I know, this was an experiment, but as AI gets widely used people will constantly have to wonder if they can't be more productive _without it._ In this case, you would definitely be faster making the graphs yourself.
Code Interpreter is not in the plug-in store, actually. It’s a native plug-in. You need a ChatGPT Plus subscription, and you need to enable it: Open ChatGPT. In the bottom left corner, select Settings > Beta Features, then toggle the Plugins setting
How do you suppose it generated that statement on the time series plot? Does it ingest the data and look at the values? Is it breaking down the output image?
I'm not 100% sure! I tried this analysis with this data set a few times, and sometimes ChatGPT did not say anything about the drop at first, and I had to ask it why air traffic dropped in early 2020. For times it seems to recognize the trend without me asking, I highly doubt it's using the .png file itself, as I don't believe the version I'm using has image recognition. I suppose it's possible that its pulling from previous chats. I use new chats each time, so it's not basing its awareness from earlier exchanges in the same chat. It's a bit of a mystery to me, though, and a great question that you're asking.
I am not able to see all the models after purchasing the plus subscription. It only shows GPT 3.5 and GPT 4 (as a tab and does not even have options). How are you able to access the Code Interpreter model?
As far as we understand, it isn’t available to all Plus subscribers yet. But there’s a chance it’s available to you, and you have to edit your account settings to turn beta plugins to the ON state. Give that a try, and if that doesn’t work, it might be a waiting game for you.
The number of smart people, like yourself, saying things like, "this is not only amazing in functionality and capabilities but it's also terrifying" is of great concern...
I am not sure how the model was able to see the data and get the trend and also explain "there was the drop in passengers in 2020". Because the model itself isn't seeing the result. It is actually making the code and then the interpreter is running the code. Then after the plot, how is the model able to see the result? Does it use some GPT-4's image reading capabilities?
Hi, how can i get this plugin code interpreter ? i've been paying fot chatgpt plus since the beginning but the only plugins i have are the third parties. Thanks
In the model selector of ChatGPT, those with access can select it from the drop-down where you choose between GPT-3.5 and GPT-4. Currently at the bottom of the selection box will appear "Code Interpreter ALPHA." We believe the waitlist is the same as the one for the 3rd party plugins, so if that option does not appear, our guess is that you'll have to wait for OpenAI to take you off the waitlist and grant access. Good luck!
will this work by connecting it to a data source like a postgres db? or it has to be csvs? do we know about its limitations at all when it comes to how much data it can analyze in a csv?
As of today, it tells me that it can accept .txt, .csv, .xlsx, .json, image formats (.png, .jpg, .jpeg, .bmp), .pdf, and Markdown files .md. I was also able to upload a zip of a shapefile to create a map, so I'm guessing there are other file types it can accept as well. Right now it seems to be just file-based only.
Good video. At the end i dont see GAI being a problem for sometime. These are great advancements and even leaps from what we had half a decade ago. Or even 1-2 years. But as long as we are still messing with massive amounts of parameters we are going to reach a computational soft limit in terms of available compute power. We are going to have to augment NN with hard code and other tools. Our advancements with LLMs and other models will open us up to capturing and evaluating nee data about ourselves and the universe. Our biggest threat is corporations keeping AI behind a toll and gate. Then gate keeping knowledge and education. You will only be able to get answers from AI for exchange of your thoughts and metadata. Once they have enough data they will take that away and either have the masses enslaved or free to fend for themselves while the capitalist/aristocracy go off to party and live like gods. They will only need enough warm bodies until all labor tasks are trained to be done by robots and AI. Waves of extinction will occur because mass layoffs and no one will be hiring.
Great video sir keep it up. And to confuse your confusion AI does tends to Hallucinations but if its doing under code interpreter it runs that code and gives the output so stop saying it will be wrong. It will always be write because its code running from Python interpreter. I mean anyone could just assume it would be correct its simple thing.
"IT" didn't do the math correctly. It didn't do any math at all. It literally wrote the code that did the math for "IT" and it output the result that the code returned. That's why it is acurate with code interpreter and innacurate without it. There are so many incorrect interpretations and poorly understood comments on what llms do. It doesn't think anything. It doesn't interptet numbers or values. It doesn't do math or science. It literally doesn't even actually chat with you. All it does is complete contextually appropriate strings (which is a very complicated and resource demanding thing to do). And becaue programming is a language and because it's been trained on massive body of code data, it is exceptionally good at writing code. Which is why it's been give this functionality via a code interpreter and not in some other way.
Yeah, that’s actually a fair point and a valid correction. I tried to make your exact point elsewhere in the video, but probably fell back on somewhat lazy shorthand in the description you’re critiquing. Perfectly valid.
It wrote Python code to do the math. That IS caled doing math. Or are you gonna say that programmers don't do math when they write code to make calculus?
Well, it all boils down to how you define “thinking” and “doing” something. I would argue that IT actually thought, just using silicon, and not neurons
i think you mean data analyst that csv file was generated by pulling data from most likely multiple sources with different formats aka data engineer job
