Тёмный

Analysing Chatflows using LangSmith - FlowiseAI Tutorial #7 

Leon van Zyl
Подписаться 24 тыс.
Просмотров 10 тыс.
50% 1

Опубликовано:

 

29 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 65   
@leonvanzyl
@leonvanzyl 4 месяца назад
The Langsmith option has moved. It can now be found under Settings -> Configuration -> Analyse Chatflow.
@ward_jl
@ward_jl 7 месяцев назад
Leon, are you planning on doing a video on LangGraph as well? Developing complex agents using LangChain, LangSmith, and LangGraph would be very interesting!
@leonvanzyl
@leonvanzyl 7 месяцев назад
Absolutely!
@RolandoLopezNieto
@RolandoLopezNieto 5 месяцев назад
Interesting request
@St_Phoenix
@St_Phoenix 19 дней назад
Did the way this works change? Followed the instructions, found the moved button, got the API key. Yet, I can't see my project in the projects section. TIA.
@leonvanzyl
@leonvanzyl 18 дней назад
Did you remember to save the change after turning on Langsmith? I make that mistake all the time 😅
@St_Phoenix
@St_Phoenix 18 дней назад
@@leonvanzyl I, in fact, did not remember to save... Thanks. it works now. I feel real clever now. lol.
@bassamel-ashkar4005
@bassamel-ashkar4005 7 месяцев назад
Leon. I did exactly as you did but I'm using OpenAI assistant node and custom tool. I get the following error when I try to send a message. it doesn't seem to be coming from the AI bur rather from a default message from flowise. API key must be provided when using hosted LangSmith API. I have added the correct langsmith API and analysis is turned on. Any idea why this error could be happening?
@bassamel-ashkar4005
@bassamel-ashkar4005 7 месяцев назад
seems like its a bug. flowise team is working on it.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Thanks for the info
@gautammandewalker8935
@gautammandewalker8935 7 месяцев назад
Amazing! More detailed video on Lang smith and other options will be great.
@iokinpardoitxaso8836
@iokinpardoitxaso8836 7 месяцев назад
Amazing video-tutorial as always ❤. Maybe you could go deeper on Datasets and How to launch-execute Evaluations? On new video Langsmith - part 2? 😊 That would be much apreciated.
@leonvanzyl
@leonvanzyl 7 месяцев назад
You're right. There is so much more to cover on Langsmith. I'll work on a separate Langsmith series perhaps.
@ChristopheDELEBARRE
@ChristopheDELEBARRE 8 дней назад
Many thanks, Leon. It is clear and very helpfull.
@MahmoudShakershakercs
@MahmoudShakershakercs 5 месяцев назад
When I use PDF in RAG , I want the user to ask, "In which page number did you get this data ?" the model responds to him with a page number , How can I do it ?
@rushitparmar2042
@rushitparmar2042 4 месяца назад
Hi, I installed flowise ai recently and I am not getting the option “analyze chatflow” like you showed in this vedio. How can I connect lamgsmith to analyze chat flow ?
@leongodwin69
@leongodwin69 7 месяцев назад
This is so good. I love your detailed, well paced, and easy to understand instructions. I hope this series goes on for dozens more episodes, getting deeper and deeper, exploring more and more use cases with even greater integrations. I want to use the skills you are helping me develop in business scenarios
@leonvanzyl
@leonvanzyl 7 месяцев назад
Thank you very much for the compliments! The intention is to create many more episodes.
@andresripamonti8876
@andresripamonti8876 27 дней назад
Thanks Leon! Amazing work as always
@SE-fk8ey
@SE-fk8ey 7 месяцев назад
I have a problem! When i try to activate the 'analyze flow' function by entering my Langsmith API credentials, after saving, the chat stops to work. With 'chat stops to work' i mean that i can't input anything when i press the chat icon. The entirety of the input field is gray. Nothing else seems to have changed in my chain and prompt... I'm running the exact same canvas setup as you by the way.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Lol, I noticed that too lately. Simply go back to the dashboard and then go into your chatflow 👍
@ahmedkhalidak4515
@ahmedkhalidak4515 7 месяцев назад
Thank you Leon. I think that last use case should help with adjusting the Chunks values for the Splitters
@leonvanzyl
@leonvanzyl 7 месяцев назад
You're 💯 correct!
@lancerkind
@lancerkind 7 месяцев назад
Brilliant work! I am in need of this detail. Are there other things we should know about debugging with Flowise? Such as log files? Or do you think that langsmith tyoe tools provide all that’s needed.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Thank you 👍. You can view the console to see Flowise related messages, like exceptions. Langsmith is my preferred tool for analysing the chatflows.
@123xxxify
@123xxxify 4 месяца назад
Why we dont have the Chain Analyze option in the settings menu
@leonvanzyl
@leonvanzyl 4 месяца назад
Flowise like to move things around. It's under settings and config.
@TheBestgoku
@TheBestgoku 7 месяцев назад
how are they going to charge people? i don't get it. I am using their system(flowise) for a few simple bots on my servers. how will lanchaing charge me??? what am i not undersatnding?
@leonvanzyl
@leonvanzyl 7 месяцев назад
I think you are referring to LangSmith. Langchain and Flowise is free to use. You do not have to use Langsmith though. It's an optional tool that simply assists with debugging.
@TheBestgoku
@TheBestgoku 7 месяцев назад
@@leonvanzyl thank you for explaining, i was just amazed , like what technology do these guys have that is going to charge me when i dont even have a bank linked. i understnd that its if u ink the api then they will
@rifkyabdillah8505
@rifkyabdillah8505 Месяц назад
can flowise connect to whatsApp sir?
@leonvanzyl
@leonvanzyl Месяц назад
Check out this video 😁. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-91aW9YGr6lo.html
@servicosmkt
@servicosmkt 2 месяца назад
QDRANT
@Trashpanda_404
@Trashpanda_404 5 месяцев назад
Using DigitalOcean, would you use Docker to build Flowise, Lamma 3, and then LangSmith? Flowise already uses LangChain, so no need for that? Then in another docker you could run LangGraph, and maybe another for ActivePieces? Now it's getting complicated. Oh yeah, you would also need another for something like a PostGreSQL. smh... Then take some tylenol, create a agent to sing you a lullaby, and take a nap. lmao... Thanks for all of the videos brother! You are a beast and a legend!
@abiolasamuel8092
@abiolasamuel8092 7 месяцев назад
When building a custom GPT in ChatGPT4 there's a feature called Conversation Starters. Not sure whether Flowise have same feature.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Would have been awesome! Hopefully they implement something like that soon.
@iokinpardoitxaso8836
@iokinpardoitxaso8836 7 месяцев назад
It is ready on Flowise. Just click on top right Setting button for any chatflow and under "Starter Prompts" you should be able to add them.
@abiolasamuel8092
@abiolasamuel8092 7 месяцев назад
@@iokinpardoitxaso8836 that was quick.
@abiolasamuel8092
@abiolasamuel8092 7 месяцев назад
@@iokinpardoitxaso8836 Is there a way to personalize the default message in the chat window? The default message is "Hi there! How can I help?". Any way to change that?
@mohamedgabr9954
@mohamedgabr9954 6 месяцев назад
Thank you. Great work . Can you please make another detailed video about evaluating LLM response using Langsmith? And how we can enable the chatbot users to give feedback about the response in the resulting chatbot? And how to make this feedback using 3rd party apps .... For example python applications?
@mohitpatil2236
@mohitpatil2236 5 месяцев назад
In setting there is no option show of "ANalyse chatflow" for me
@mohitpatil2236
@mohitpatil2236 5 месяцев назад
sorry for this comment i got ans
@leonvanzyl
@leonvanzyl 5 месяцев назад
It was moved to settings / config / analysis
@stephenwhiting8508
@stephenwhiting8508 6 месяцев назад
Leon love, love, love these videos. When I try to upload a file from S3, I keep getting the error "Unable to load file in the unstructured loader" I am using their paid version and its a hosted version of flowise.
@stephenwhiting8508
@stephenwhiting8508 6 месяцев назад
@leonvanzyl any idea how to solve?
@stephenwhiting8508
@stephenwhiting8508 6 месяцев назад
Solved it
@leonvanzyl
@leonvanzyl 6 месяцев назад
Hi there. The S3 loader is definitely a bit more complicated than the other loaders. You need access to an unstructured.io API (either self hosted, or with unstructured.io cloud). You also need to set up access to the S3 bucket. This probably requires a dedicated video.
@leonvanzyl
@leonvanzyl 6 месяцев назад
Awesome, what was the issue?
@stephenwhiting8508
@stephenwhiting8508 6 месяцев назад
@@leonvanzyl Thanks Leon. Also a fellow SA, but living in Canada now.
@EmoteB
@EmoteB 7 месяцев назад
First of all, I want to thank you for your work in creating video guides. I'm using Flowise and it's giving me very good results, but I have a small issue that I'm not quite sure how to solve. When I use agents with custom tools, the agent sometimes doesn't use the tools. I work a lot in the prompt to make them use the tools (to bring and modify information from a database), but as the context grows, the use of the tool ends up being lost and the agent ends up inventing information. I'm not sure if there's any solution to this with chain nodes since I can't use custom tools with chains. It would be great if you could make a video at some point about using agents and chains together or if there's any strategy to this issue I'm having. Best regards.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Thank you! Agents video will release soon. Hopefully that will help. All you can really do is lower the temperature, to 0 if need be. Use GPT-4 or greater. Add instructions to the system message to tell the model to use the tool.
@yanzhang1181
@yanzhang1181 7 месяцев назад
Love your LangChain tutorial. Any Flowise LlamaIndex tutorial to create production-ready apps?
@leonvanzyl
@leonvanzyl 7 месяцев назад
I'm waiting for Llama Index to come out of Beta 👍
@OstrichCode
@OstrichCode 6 месяцев назад
Thanks Leon! It's powerful. I can analyze Chatflow using LangSmith with localhost:3000. However, the 'Analyse Chatflow' option disappeared after I deployed Flowise with Render.
@leonvanzyl
@leonvanzyl 6 месяцев назад
Ensure you deploy the latest version of Flowise to Render. In the latest version of Flowise they moved the Analyze chatflow option to a nested option under settings.
@OstrichCode
@OstrichCode 6 месяцев назад
It has been moved to the Chatflow Configuration. Thank you so much@@leonvanzyl
@IdPreferNot1
@IdPreferNot1 7 месяцев назад
Shows how why my token cost exploded with "pseudo memory" feature simply passing entire chat each time. It will be interest to see how this, and more importantly, explicit RAG may be anachronistic in a years time. Here's to a 10MM token context window next year!
@leonvanzyl
@leonvanzyl 7 месяцев назад
Image the cost of passing in a million tokens which each request 😁.
@IdPreferNot1
@IdPreferNot1 7 месяцев назад
Stateless LLM's need to change... but just realized that if its no longer stateless, its probably AGI!! @@leonvanzyl
@topodin
@topodin 7 месяцев назад
In the final LLM response, how do you assemble a common response from several sequentially constructed LLMChains if each previous response is an invitation to the next LLMChain? I use Prompt Chaining from the marketplace (Use output from a chain as prompt for another chain)
@topodin
@topodin 7 месяцев назад
or how to save the chain of reasoning into the final assembled answer if autoGPT is used?
@leonvanzyl
@leonvanzyl 7 месяцев назад
All the outputs from the previous chains can be added to the final prompt. Simply create placeholders / variables for each of the previous chains in the final prompt template and map their values. You can then give the prompt and instruction to format all these values in whatever way you want. For interest sake, what's the use case?
@topodin
@topodin 7 месяцев назад
@@leonvanzyl Thanks for the tip. I was just guessing that's how it's done. I wonder if it will result in re-spending tokens in the final build. The variant in which I use it is the preparation of marketing research related to the identification of pain points in the audience and further development of this idea in the text of advertisements, which takes into account these pain points.
@JoaquinTorroba
@JoaquinTorroba 7 месяцев назад
Thanks Leon! Amazing content.
@leonvanzyl
@leonvanzyl 7 месяцев назад
Thank you!
Далее
Watermelon magic box! #shorts by Leisi Crazy
00:20
Просмотров 16 млн
КВН 2024 Встреча выпускников
2:00:41
Inside Out 2: BABY JOY VS SHIN SONIC 4
00:16
Просмотров 3,9 млн
AI in n8n: Supercharge Your Workflows in Minutes!
17:21
Unlocking the SECRETS of LLM with LangSmith
41:37
Просмотров 66 тыс.
Add Flowise to ANYTHING! Flowise API Crash Course
28:17
FlowiseAI: No Code ChatBot & LLMs Apps Platform
13:20
Просмотров 3,2 тыс.
Watermelon magic box! #shorts by Leisi Crazy
00:20
Просмотров 16 млн