Data Analysis with PandasAI and Ollama - Locally and Free

Подписаться 4,6 тыс.

Просмотров 6 тыс.

50% 1

Today, we'll cover how to perform data analysis with PandasAI and Ollama using Python. At the end of the video, with generative AI, you'll learn data analysis projects locally and for free.
🔗 Let's connect:
Medium: / tirendazacademy
X: x.com/tirendazacademy
LinkedIn: / tirendaz-academy
00:01 Introduction
00:40 What is PandasAI?
01:05 Setup
02:55 Load the dataset
03:54 Initialize the model
06:10 Chat with your data
🔗 Project files: github.com/TirendazAcademy/Pa...
▶️ LangChain Tutorials:
• LangChain Tutorials
▶️ Generative AI Tutorials:
• Generative AI Tutorials
▶️ LLMs Tutorials:
• LLMs Tutorials
▶️ HuggingFace Tutorials:
• HuggingFace Tutorials ...
🔥 Thanks for watching. Don't forget to subscribe, like the video, and leave a comment.
#ai #openai #generativeai

Наука

Опубликовано:

1 мар 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 43

@GhostCoder83 2 месяца назад

Thanks Bro. Very Helpful.

@TirendazAI 2 месяца назад

Glad it helped

@HistoryIsAbsurd 3 месяца назад

Definitely worth the sub! Was lookin for exactly this Edit: also, thank you!

@TirendazAI 3 месяца назад

You're welcome!

@mapledev9335 2 месяца назад

PandasAI is brilliant. Thanks for putting this video together!

@mapledev9335 2 месяца назад

I used the same question but only get the table. Change it a bit and I get a bargraph. Rephrase the question again and I get an error. Any suggestions how to get both the table and chart like in your video?

@TirendazAI 2 месяца назад

Prompt engineering is important to get good results. I got this response by trying a few prompts. You may write more detailed prompts.

@charlesoni2787 2 месяца назад

Nice. Thanks

@TirendazAI 2 месяца назад

You're welcome!

@AliAlias 4 месяца назад

Thanks very much ❤❤❤ I wait this video for long time 😊 Q: what is best open source LLM from hugging face used for PandasAi & SQL data analysis

@TirendazAI 3 месяца назад

You're welcome. Choosing the best model varies from task to task. I love working with Mixtral for PandasAI.

@PuffNSnort Месяц назад

Great video! What are the dataset size limitations? I get an answer 30% of the time and errors the rest of the time.

@TirendazAI Месяц назад

Large models like Llama-3:70b and GPT-4 respond better.

@aroonsubway2079 2 месяца назад

Thanks for this great video! One question from me: Since the classical pandas style data analysis performed well, what is the potential advantage of using LLM? Is it possible that LLM can introduce more intelligent analysis than excel?

@TirendazAI 2 месяца назад

The advantage of this tool is that you can use it to explore, clean and analyze your data using generative artificial intelligence. All you need to do is talk to your data. If you put in good prompts, you can get good outputs. You can also use this library to analyze your Excel data.

@aroonsubway2079 2 месяца назад

@@TirendazAI Yes, an user-friendly QA is definitely something important. Thanks! But do you think we can find a scenario that Excel fails because it is not intelligent enough, but LLM has a chance to outperform Excel?

@TirendazAI 2 месяца назад

LLMs have huge potential for data analysis. Yes, they are not intelligent enough. We can think of them as a black box but, you can provide that they return good outputs using agents or RAG techniques.

@deepakkapoor5427 2 месяца назад

facing this error 'Unfortunately, I was not able to answer your question, because of the following error: No code found in the response '

@TirendazAI Месяц назад

When a prompt does not work, I am trying again by changing this prompt.

@user-mv9ul9tz1c 2 месяца назад

The tutorial video was truly amazing, with very clear subtitle translations. However, I'd like to know how to use PandasAI + Ollama in VS Code like you demonstrated. Also, how can I implement Ollama + Llama3 + LlamaIndex? What are the minimum computer specifications required for such usage? Additionally, how should I write the Python code to ensure that your consecutive queries are processed in the same thread? Best regards;

@TirendazAI Месяц назад

For example, you need a minimum of 7B RAM to work with a 7B LLM version. Unfortunately, the responses generated by LLMs are not stable. You need to try several prompts to get the output you want.

@user-mv9ul9tz1c Месяц назад

@@TirendazAI Thank you very much. However, my current computer setup includes an i7 processor, an RTX 2060 6G graphics card, and 16GB RAM. Can I run a local LLM with these specifications?

@TirendazAI Месяц назад

Yes, you can run a local LLM such as Llama3:8b or mistral:7b.

@user-mv9ul9tz1c Месяц назад

@@TirendazAI Thank you for your response. Originally, I planned to spend about $120 to upgrade my laptop's standard RAM from 16GB to 64GB. Additionally, could you tell me what software you used in your video demonstration? The interface looks very similar to VS Code, which I am currently trying to learn on my own. However, I'm not sure how to set up the environment. My command prompt shows Python 3.10.6. Do you have any videos that explain how to install Python and use related editors? Setting up the Python environment seems a bit complex, as it appears you have to set the environment before running the program.

@ajithnaidu6978 2 месяца назад

Hi , Unfortunately I'm not able to install pandasai in the terminal it showing could not find a version that satisfies the requirement pandasai

@TirendazAI 2 месяца назад

Hi, did you create a virtual environment? If yes, you can also use this command: poetry add pandasai

@ajithnaidu6978 2 месяца назад

This poetry add pandasai used in the terminal or cell?

@liuivy2840 3 месяца назад

'Unfortunately, I was not able to answer your question, because of the following error: No code found in the response '

@liuivy2840 3 месяца назад

I change population.csv Country to CountryName ; Population to populations; it works ..

@TirendazAI 3 месяца назад

👍

@sonidosdetranquilidad 3 месяца назад

It does not work for me. I got the following error message: 40 if llm is None or not isinstance(llm, LLM or LangchainLLM): ---> 41 raise LLMNotFoundError("LLM is required") 42 return llm LLMNotFoundError: LLM is required

@TirendazAI 3 месяца назад

Make sure you install Ollama and download a model

@JAlcocerTech 3 месяца назад

Hello @tirendazakademi, Same Error for me. I have ollama version 0.1.28 Used: ollama pull mistral Tried with this dependencies (the ones that were latest 1 week ago when you uploaded) and got the very same error about: LLMNotFoundError("LLM is required") pandasai==2.0 langchain==0.1.10 langchain-community==0.0.25 Could you please verify which exact packages you used? Thanks and keep the great content!😁

@AlessandroPerugini-hz7pk 3 месяца назад

i have the same error, langllm work with langchain, i can call : llm.invoke("Tell me a joke") with a valid response. but SmartDataFrame does not recognize ollama as a valid LLM. i have also tried to install the github package. The only difference is ollama version is 0.1.28

@AlessandroPerugini-hz7pk 3 месяца назад

@@JAlcocerTech with miniconda i have your same version and error , with visual studio code seem to work these are the library version i have : pandas 1.5.3 pandasai 2.0.8 langchain 0.1.11 langchain-community 0.0.27 langchain-core 0.1.30 langchain-text-splitters 0.0.1 I hope this can help