Тёмный

Vector is back! A self-hosted Large Language Model meets a tiny robot from outer space 

Rhys Williams
Подписаться 89
Просмотров 612
50% 1

Vector is back on his feet again after diminishing official support thanks to the good folk at wire-pod! Man do I love open-source
I have a custom ollama based llama3 model here prompted to believe that it's a tiny little robot from outer space hehe. Forget about costly subscriptions to closed source platforms like ChatGPT!
Multi-part questions are already handled via knowledge graph support but how cool would it be to build in RAG, multi-modal scene analysis or even fully fledged ReAct (see the paper below) for more complex queries. I am definitely looking forward to messing around with it! I'd love to built this as more of a fluid voice detection interaction with something like Silero VAD. Time to get on that Python SDK and see what we can cook up I think.
Subscribe for more robot shenanigans as we go!
Sources:
- wire-pod - github.com/ker...
- ollama - ollama.com/
- ReAct - arxiv.org/abs/...
- Silero - github.com/sna...

Опубликовано:

 

29 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 21   
@Dimensional-Atlas
@Dimensional-Atlas День назад
How did you get this setup? Do you have a white paper guide or anything you could share?
@Alessandrosmusic
@Alessandrosmusic 2 месяца назад
THIS IS AMAZING! I have my vector connected to wire pod but my UI layout looks nothing like yours. Is there anyway you can show me how you did this?
@rhysdg-ml
@rhysdg-ml 2 месяца назад
Hey there! I'll put together a quick video tutorial shortly :) Did you set up recently WirePod v1.2.5?
@Alessandrosmusic
@Alessandrosmusic 2 месяца назад
@@rhysdg-ml yes i updated it a few hours ago! and thank you!
@rhysdg-ml
@rhysdg-ml 2 месяца назад
@@Alessandrosmusic Absolutely no problem at all 😁
@Alessandrosmusic
@Alessandrosmusic 2 месяца назад
@@rhysdg-ml i tried to do it myself but i keep getting issues with the endpoint.
@rhysdg-ml
@rhysdg-ml 2 месяца назад
@@Alessandrosmusic Are you referring to the ollama endpoint?
@raveman3330
@raveman3330 17 дней назад
Hi there, any chance to get that tutorial soon? :)
@swiftcodingbird
@swiftcodingbird 20 дней назад
how did you do this?
@BARCINO-du4dg
@BARCINO-du4dg 2 месяца назад
how did you connect wirepod to a different llm other than the default options?
@rhysdg-ml
@rhysdg-ml 2 месяца назад
Hey there! I have a local ollama deployment running with a custom model. I'll have a tutorial on the way soon!
@BARCINO-du4dg
@BARCINO-du4dg 2 месяца назад
@@rhysdg-ml thanks!
@Void_zxx
@Void_zxx 3 месяца назад
I love my vector he’s always happy and always want to play
@rhysdg-ml
@rhysdg-ml 3 месяца назад
Haha Nice! Now he's back on his feet and open-source I'm going to bust out some crazy custom animations and a whole custom machine learning module when I have time. So little time!
@superradmaker
@superradmaker 3 месяца назад
This is too cool! I always wanted a cozmo/vector and they inspired me to learn robotics to create desktop robots. Im still a rookie but cant wait to play around with LLMs on my bots in the near future.