Тёмный

Google Colab + Kaggle - Downloading Datasets & Uploading Submissions from a Notebook 

Adrian Dolinay
Подписаться 3,4 тыс.
Просмотров 10 тыс.
50% 1

Опубликовано:

 

7 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 40   
@ayushnayak6138
@ayushnayak6138 2 года назад
This was helpful thanks
@saswatuna7707
@saswatuna7707 2 года назад
Could you do a video over how to clean data from a dataset in Kaggle
@zooltechno7065
@zooltechno7065 Год назад
after running command " ! kaggle datasets download -d 'name-of-dataset'" it is generating Error 403: forbidden
@taiyosuzuki2637
@taiyosuzuki2637 3 года назад
Hello, Adrian. When I download the file, all the files are downloaded randomly. How can I get it to download like a kaggle file? Is there any way to avoid this?
@AdrianDolinay
@AdrianDolinay 3 года назад
Can you explain a bit more on your issue? Are you having issues with downloading larger datasets with multiple files such as the "A Large Scale Fish" dataset which is 3 GB and contains multiple folders?
@taiyosuzuki2637
@taiyosuzuki2637 3 года назад
@@AdrianDolinay Adrian, thank you. I wrote some code to configure it, and it worked. I think my first code was wrong. Sorry about that.
@wizix9877
@wizix9877 3 года назад
does it actually unzip the chess file and load csv?
@AdrianDolinay
@AdrianDolinay 3 года назад
Hi! My preferred method is to read in the zipped file into a pandas DataFrame like I did at 8:57.
@wizix9877
@wizix9877 3 года назад
@@AdrianDolinay what i meant is loading the zip file directly into set would not give you proper values...i think you have to unzip it first. unless the read takes care of uncompressing it. check the values u got in the video.
@AdrianDolinay
@AdrianDolinay 3 года назад
Yup, pandas will unzip it. The documentation outlines how read_csv unzips it under the "compression" parameter. Please let me know if you have any additional questions! pandas.pydata.org/docs/reference/api/pandas.read_csv.html
@misrahmaqboolofficial
@misrahmaqboolofficial Год назад
I couldn't download datasets from gaggle As i got message cannot create directory
@AdrianDolinay
@AdrianDolinay Год назад
Was the error on the "!mkdir ~/.kaggle" line?
@misrahmaqboolofficial
@misrahmaqboolofficial Год назад
@@AdrianDolinay yes
@AdrianDolinay
@AdrianDolinay Год назад
@@misrahmaqboolofficial Are you running this in Google Colab or on your local computer?
@misrahmaqboolofficial
@misrahmaqboolofficial Год назад
Google colab
@taiyosuzuki2637
@taiyosuzuki2637 3 года назад
It means there is no folder.
@kelijunior7871
@kelijunior7871 3 года назад
How would I upload datasets submission directly from the notebook?
@AdrianDolinay
@AdrianDolinay 3 года назад
At 9:58 I go over how to submit it, let me know if you still have issues!
@kelijunior7871
@kelijunior7871 3 года назад
@@AdrianDolinay I'm having problems because I am brand new to machine learning. I do not understand the proper algorithms I need to input into Google Colab. I am working on Supervised Learning now. I have looked and looked for something to take me step by step in setting up the algorithms in Google Colab, and cannot find nothing. Is there a place I can go to and be able to look at supervised algorithms for K-Nearest Neighbors which falls under supervised learning to do my project?
@AdrianDolinay
@AdrianDolinay 3 года назад
@@kelijunior7871 I just released a video on KNN. If you're looking to implement a KNN classification algorithm it should help. You can access the notebook through GitHub as well. Hopefully it helps! KNN Vid on RU-vid - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-l3TP8wickk4.html&ab_channel=AdrianDolinay
@AdrianDolinay
@AdrianDolinay 3 года назад
@@kelijunior7871 KNN notebook on GitHub, under "Machine Learning" folder - github.com/tudev/Workshops-2020-2021
@carbon_molecule
@carbon_molecule 3 года назад
Please help me... I used the api properly still Whenever I download any competition dataset only CSV and few data(i.e. images ) downloads and most of the file doesn't download
@AdrianDolinay
@AdrianDolinay 3 года назад
Which competition?
@carbon_molecule
@carbon_molecule 3 года назад
@@AdrianDolinay dog breed identification
@AdrianDolinay
@AdrianDolinay 3 года назад
@SomeOne try the code below import zipfile !pip install --upgrade --force-reinstall --no-deps kaggle !kaggle competitions download -c dog-breed-identification with zipfile.ZipFile('/content/dog-breed-identification.zip', 'r') as zip_ref: zip_ref.extractall('/content')
@carbon_molecule
@carbon_molecule 3 года назад
@@AdrianDolinay but no zip gets downloaded when I use api to download
@AdrianDolinay
@AdrianDolinay 3 года назад
@@carbon_molecule hmm, when I run the above code all the data is downloaded within Google Colab. Are you using a different IDE? The issue is the current Kaggle API is outdated, but once you run the above code it gets updated.
@ravikshdikola6089
@ravikshdikola6089 3 года назад
when i am doing submission it shows me 400 bad request
@AdrianDolinay
@AdrianDolinay 3 года назад
The first thing I suggest is double checking that the competition name is correct. It also may be an issue on Kaggle's end. If you keep having issues submitting with the API I suggest posting your issue on Kaggle's "Product Feedback" forum. Hope this helps! www.kaggle.com/product-feedback?sort=most-comments
@ravikshdikola6089
@ravikshdikola6089 3 года назад
@@AdrianDolinay i think its an issue related to api because i have checked everything but again giving me the same error.
@carbon_molecule
@carbon_molecule 3 года назад
By the way do you know about Cyber security?
@AdrianDolinay
@AdrianDolinay 3 года назад
Yup! I'm interested most by cryptography, I'll continue to post videos exploring that topic and how to implement cryptographic applications within Python. I also have broader interest in cybersecurity that I plan to explore down the line
@carbon_molecule
@carbon_molecule 3 года назад
@@AdrianDolinay that's nice.... Can you please help me in continuing my journey from a intermediate to advanced
Далее
Google Colab - Printing with Markdown!
5:34
Просмотров 2,5 тыс.
Bike vs Super Bike Fast Challenge
00:30
Просмотров 6 млн
🎙А не СПЕТЬ ли мне ПЕСНЮ?🍂
3:04:50
Bike Challenge
00:20
Просмотров 21 млн
How to Make a Data Science Project with Kaggle
21:00
Просмотров 132 тыс.
First hour with a Kaggle Challenge
50:20
Просмотров 129 тыс.
How to upload Google Colab notebook into Kaggle
12:30
Просмотров 2,7 тыс.
Loading Kaggle data directly into Google Colab
10:45
Просмотров 44 тыс.
ChatGPT for Data Analytics: Full Course
3:35:30
Просмотров 263 тыс.
This is why Deep Learning is really weird.
2:06:38
Просмотров 386 тыс.
Bike vs Super Bike Fast Challenge
00:30
Просмотров 6 млн