Better Searches With Local AI

Подписаться 34 тыс.

Просмотров 28 тыс.

50% 1

In the ideal world, you would have the accuracy of a web search and the ease of an AI. Perplexica gives you that along with all the privacy and security benefits of Ollama. Check it out.
You can find perplexica at: github.com/itz...
You can find the code for every video I make at github.com/tec.... Then find the folder name that starts with the date this video was published and a title that makes sense for what the video covers.
Be sure to sign up to my monthly newsletter at technovangelis...
I have a Patreon at / technovangelist
You can find the Technovangelist discord at: / discord
The Ollama discord is at / discord
(they have a pretty url because they are paying at least $100 per month for Discord. You help get more viewers to this channel and I can afford that too.)

Опубликовано:

28 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 57

@kushagrasri 4 месяца назад

Hi Matt! thanks for checking it out. I'm working on major features like chat history, discovery, and new search types, and will roll them out eventually. It is still very early for Perplexica, but we're slowly reaching there. The searches are slower because Perplexity directly returns the result to the model instead of performing a similarity search. We do the opposite; after the search is complete, the results are refined and then returned to the model, this ensures that the context is very precise and the answers are some time better than Perplexity. We're working on adding some search types that allow you to disable this option.

@dotcomphoto7347 4 месяца назад

That sounds great! Is it possible to use its services as API as well? Or just through the UI?

@new_artiko 4 месяца назад

yeah, sound amazing! it is a open source project?

@mbarsot 4 месяца назад

hi, great start for perplexica. My use case is creating news bullettin with queries like "top news from bbc news website, translated in italian with a title and a summary". Now: sometimes it works, sometimes it does not at all, others the reply is related to spurious parts of the bbc website (how to subscribe etc). Can you have us have a look at what is actually scraped from the websites (and which websites are selected), in order to make better queries to Perplexica ?

@riok4523 3 месяца назад

being able to add docs would be a huuuge plus!

@joshharrison6020 4 месяца назад

To be honest, if the application only offered a light mode, I would be less inclined to use it. I tend to use everything in dark mode. It’s not because I’m trying to reflect a certain persona or mood, but rather, I find that dark mode is easier on the eyes. This preference becomes particularly noticeable when I’m using the computer for extended periods, up to 18 hours at a time. The reduced strain on my eyes makes the experience much more comfortable.

@technovangelist 4 месяца назад

I feel like this is a video I need to make, since this is flat out not true. It can feel like its easier at a point when you should be looking away, but it can cause issues later on, and its especially bad for 30% of the population. It's kind of like when folks say they are visual learners when most of the science based evidence says there is no such thing.

@svenvanwier7196 4 месяца назад

@@technovangelist while it might not be true, I experience the same, I think its all subjective. but never researched it. You made a genius point about probably touching some grass if strain comes into play xD

@ts757arse 4 месяца назад

Make that video. I use dark mode most of the time and I find it depends on the monitor, surroundings and even the time of day. My laptop is awful to use in dark mode and I find it tiring and harder work. My main PC has four monitors, the two best ones being great in dark mode and the two cheapo ones being awful. I keep that whole system in dark mode and use the secondary monitors for things like open directories, Spotify, etc.

@Ammarsays 3 месяца назад

Hi. Nice content. I like the pace of your videos. Everything is peaceful and interesting without loud music or dramatic sound effects. Please review fabric ai coupled with agents which are included with it.

@technovangelist 3 месяца назад

Yeah, yeah, yeah. Fabric AI. Gotta do that one. Every now and then, I do add a little bit of music or a few sound effects, but I try not to make them too over the top.

@blossom_rx 4 месяца назад

Hi Matt. I just stumbled upon your channel. I am really impressed! Thanks for providing actual knowledge instead of using clickbaity video titels without any real value. Keep it going. I hope your channel will be most successful. Quality over quantity.

@DanielKirsch 4 месяца назад

The profile shots are a bit weird. Not sure you should add them.

@DanielKirsch 4 месяца назад

The awkward silence at the end is hilarious though.

@alvinnorin8820 3 месяца назад

The end was really appreciated.

@daan3298 4 месяца назад

What do I think? There are so many cool projects. But so little projects that make significant effort to combine all the cool projects. Some kind of standard that makes it easy to combine tools, use them as agents or whatever, that would be great. That's what I think.

@vulcan4d 4 месяца назад

Amazing work!

@dotcomphoto7347 4 месяца назад

Really nice! Is there a way to use it as api as well? Or just using the UI?

@ihaveacutenose 4 месяца назад

You da man! That's exactly what I wanted to know!

@maximeaube1619 4 месяца назад

self hosted AI search engine ? didn't know about it. Very interesting, will definitely try

@ThoughtFission 3 месяца назад

What is currently the best RAG solution for docs?

@technovangelist 3 месяца назад

That’s like asking whats the best model or whats the best car. There is no best and there can never be. It depends on your requirements.

@UsmanAli-po5cm Месяц назад

You can add Groq API in Msty and that will enable the real-time search mode. How is this better than Msty?

@technovangelist Месяц назад

Same reason as wanting to use Ollama... comes down to security and privacy and sometimes cost.

@UsmanAli-po5cm 26 дней назад

@@technovangelist I installed and tested it. Msty with real time data enabled provided better search results. Perpelxica took nearly 20 gigabytes of my hard disk storage and results were no where as good as Msty with real time data enabled. Uninstalled it!

@dvn8ter 4 месяца назад

⭐️⭐️⭐️⭐️⭐️

@ambarrlite 4 месяца назад

Page Assist, an extension for chrome or firefox Ive been using awhile, does searches and can summarize the page. I forgot to add it uses local ollama models :)

@technovangelist 4 месяца назад

I covered that in an earlier video. Perplexica does it in a very different way and is far more successful.

@ambarrlite 4 месяца назад

@@technovangelist I may have missed that vid, and I thought I had seen them all. I am a big fan of ollama. :)

@tvwithtiffani 4 месяца назад

I simply love your reviews. Clearly highlighting pros & cons. This is how it should be done.

@solporcima 2 месяца назад

Hello there I am wondering to see a video using ollama+ webui with web search + local llm

@MH-xx6df 4 месяца назад

Lightmode? Pleasing? C’mon, ever heard of circadian rhythms? Going out of whack due to monitor light. Let’s widen our knowledge base into more than just the digital world.

@technovangelist 4 месяца назад

Your comment goes in two directions. First talk about rhythm, accepting that light mode is important, then you make up stuff about going out of whack due to monitors suggesting that dark mode is any better. Choose the argument and stick with it. Perhaps widen your knowledge to facts and not just made up stuff.

@Slimpickens45 4 месяца назад

Holy smokes this is cool. Great stuff as always Matt!

@nadpro16 3 месяца назад

I love it when I find something like this that im like, ooh I like that. Lets give it a try. And its broken....seigh.

@IdPreferNot1 4 месяца назад

Appreciate your shares and balanced reviews.

@MeinDeutschkurs 3 месяца назад

What a great thing. Temporary embeddings for web research. ChromaDB + python + selenium. Should do it. Thx for inspiring me!

@technovangelist 3 месяца назад

nice

@mbarsot 4 месяца назад

I think it is great, or in fact great potential. Would love to have a more stable retrieval from the web (see comment to the author down below), but in general most programs that work with ollama seems to be very good, so it is hard to settle to one solution (a good thing, in this case)

@jacobbobo4670 3 месяца назад

All of the dockers are running, but when I go to port 3000 I just have a loading screen that's been going for like 20 minutes. Does anyone know what I'm doing wrong? also Im running it through wsl.

@c0t1 4 месяца назад

Another awesome video! Can't wait to try this out.

@r-news-ny 4 месяца назад

Hi Matt, I wanted to ask if you could create a python script that will allow ollama +open webui to be able to search the Internet. I want to know if this idea will work? I'm new and learning this😊😊😊😊

@gu9838 4 месяца назад

plus having an offline option is great cuz i got to the perplexity website just now and it says there are too many users asking questions and yeahhhhhhhh great lol

@inout3394 4 месяца назад

Msty, make simple app to search, use api, and rag

@Maisonier 4 месяца назад

All this AI technology is still pretty green ...

@dr.mikeybee 4 месяца назад

Which branch are you using?

@technovangelist 4 месяца назад

The main one

@قيمنقعبود-ب2ل 3 месяца назад

Thanks. So what should we use for searching our documents.

@technovangelist 3 месяца назад

This space is changing quickly, so I'm sure there's going to be another tool to try out for doing everything you could ever want. I think right now my favorite for doing a rag search is still OpenWebUI.

@jofus521 4 месяца назад

I think there is a space for a robust knowledge curation app, so we can save the valuable results and tag them. Got a whole bunch of ideas around that. You always have fresh stuff, man. Wish I could pick your brain sometime. Planning to do something in all golang.

@technovangelist 4 месяца назад

Ping me on the discord or if you are near Seattle we can meetup.

@jofus521 4 месяца назад

Cool thanks @technovangelist. On what server? A little new to discord. Can’t find a way to search. I’ve only joined from invites so far

@technovangelist 4 месяца назад

Discord.gg/ollama. I’m mattw tvl.st/y