A simple question, what time is it... as a language model I have no idea... where are you? I have no idea either, another sum 0+0 and explain how you got the result
Thanks for the video! So the demo retrieved "pages", if we want the actual paragraph or sentence-level sources we have to do an additional retrieval on the retrieved pages, right? I saw your Gemini PDF video and was wondering how ColPali performs compared to that.
In my exprience, it's much better in coding and debugging. GPT-o will constantly gaves me answer that don't really matters to the problems, o1 can always find the problem at first feedback.
Are you sure the serverless method worked, i find that if the model does not have a config.json file provided on huggingface, it simply wont work. infact i had a lot of problems running quantized models using the serverless endpoint. If you take requests, i would loke to see a more detailed walt through of how to truely use any model (with vLLM support ofc) from huggingface, in the models different quantized states. But thank you for sharing, you truely make some good content.
The issue where the model isn’t generating all of the code likely stems from maintaining a large context. I refer to this as "LLM dementia," which I have also encountered when working with Anthropic. What you need to do is request complete documentation of the code, then start a new chat with the documentation and code included. From there, you can proceed. The challenge you're facing is that you're unable to attach files for preview.
I am sure this is a very interesting topic, but i have no idea what are you talking about 😐. Is there anyway somebody can summarize it in simple words. I really want to know.
WHY NOT TO DO SMARK CHANKING ON CONTENT. LIKE WHEN NEW TOPIC STARTS? NEW SENTENCE, ETC? YOU WILL USE FAST LLM TO GENERATE CHANKS. THERE WILL BE LESS NEED FOR OVERLAP.
How to generate those context for chunks without having the sufficient information to the LLM regarding the chunk? How they are getting the information about the revenue numbers in that example? If it is extracted from the whole document then it will be painful for llm cost.
Thank you for your expertise! Could you recommend a stable and efficient large language model for coding that I can run on my machine without it becoming unresponsive?
Good information, but having a child crying in the background is unprofessional. Of course now everyone will say I hate children, but I don’t care. I’m sick of unprofessional behavior.
I want to add this as a the default way the rag is handled in open webUI but its conflicting with other stuff, I tried to make a custom pipeline for it but i'm struggling to make it work is it out of the scope of open web UI or am I just not understanding the documentation properly
Would this work for asking gemini to write code using a private COM interface by passing the COM documentation via context caching? I've been trying to do this with a custom GPT and have not been able to get it working very well, mostly because of limits on the knowledge files for GPTs.
@Prompt Engineering didnt find a clear answer for my question, so I ask you. as a screenplay writer what do you think is the best model for me? gpt has very short memory. (not enough token memory)
What happened if the document contains a lot of images like tables, charts, and so on? Can we still chunk the document in a normal way like setting a chunk size?
@@kai_s1985, so we don't need to chunk our documents if we use vision based RAG? My problem is how are we going to chunk our documents even though the LLM has vision capabilities
@@limjuroy7078 it is very different from the text based rag. But, I think you need to embed images page by page. Look at his video or read the ColPali paper.
