How To Install Fabric - Open-Source AI Framework That Can Automate Your Life 

Thank you for keeping me on the cutting edge. I have been trying to cobble something together with CrewAI, but this framework is intriguing and I'm installing it now!

This is the best and most practical/useful AI chennels of all. Thanks again!

What's cool is that one can integrate these prompts into any project.

Interesting, I'm not sure what exactly it's doing, but what we really need is premade(tested and working) functions that work with LLMs to process data, such as: Retrieve information from the internet on topic x, then process, summarize, etc, so many result pages. Process a pdf/docs, summarize, extract data for model fine-tuning, rewrite, etc. That would be an interim solution before we get truly capable, immediately accurate models. Not crazy about them inventing what seems like unnecessary nomenclature.

I’m excited! That’s really powerful. Have to check the original sources. Thx Mathew!

Thanks again, Matthew. Another excellent vid. Concise, accurate, genuine, no fluff.

Imagine using the patterns in a vector DB (meaningful description and then the output instructions) but instead of using Fabrics pretrained ones they let you build your own in their framework. You can ideally train business ready "templates" to complete and save time and money. I hope they expand on this framework will be interested to see how they can integrate into different environments and allow the user to customize this further! As always thank you for keeping us in the loop of new tech out there! Much appreciated!

Matt, you are a machine. Thank you for what you do.

This is gas! ⛽️Thank you mister Berman!

Could you make a video of this with Llama3 in a local computer please?

Thank you! Very well done.

Receiving your grade sounded as awesome as having to do extra yard work. I wonder if these prompts could be like written as text on a BBS or SMS? then while holding down the Ctrl key press the letter C, locate an AI interface you want to use it in and again hold down Crtl but press P this time. WA-la!

Awesome! . Thanks for video. It worked for me.

Love to see instructions on how to use this with ollama and or other open source offline tools.

Honestly pretty convoluted. Plus weird terminology like loom, fabric etc if one is prompt challenged one can just ask the LLM to create you a good prompt!

Yes awesome project! FYI I’ve made a bunch of Pattern demos as Shorts

I made something like this yesterday made a nice collapsing scroll menu with a bunch of sample questions that you can just click on.

Awesome information

Thanks for this video. Very interesting. Would like to seem more use case examples from the available prompts if you have time to put something together.

Can you make a recap video with a summary of the tech you propose and which one you suggest for each category?

Hi and have a nice day, my name is René and I am trying to realize a project that connects several OpenSource LLM's with an agent framework. Each LLM is supposed to solve a specific task. Unfortunately, I can't describe it as well as I would like to, but I'll give it a try. It is about receiving, unpacking and analyzing a PST file. There should be a separate trained LLM for each area of the analysis. For example, an LLM that graphically displays the connections of the suspect to others, one that is trained with different languages to search in all possible languages, .... so the whole thing is briefly outlined. Since I am still relatively new to this area, I would be very happy to receive tips and tricks. Thank you and best regards from Austria

Matthew's smirk when he says I am gonna revoke this key before I publish this video is insane.

Cool project. Shouldn't be too hard to write a small frontend with a dropdown list of all prompts for this.

If you are on windows 11 using WSL, pbpaste won't work (naturally) you need to install xsel and use replace (without quotes) "pbpaste" with "xsel --clipboard --output" | your fabric pattern. This should do the same thing but on linux system or windows using wsl.

Im struggling so much to get this running with Ollama locally. I cannot seem to get fabric to check for local models. I'd love a video on this!

I would like to see a video covering the hardware to run Ai locally. Maybe it could cover what a bare minimum set up is then a ideal based set up and then finally a beast mode setup. To clarify, when I bare minimum I'm talking about a self hosted server (older pc) I know that you can do it with a Raspberry Pi, but seriously I think that would be painfully slow.

Can you show a video on how to feed a .epub book for analysis? Being able to summarize a book like that would be incredibly useful.

ok you'll get a 👍 for that one (for being an actual usage case; haven't tried it out yet though)

Pro-tip: I always use venv to create customized python environments for any AI project. Stable Diffusion front-ends actually use "venv" by default. Create a custom Python environment in your home directory (~/venv) python -m venv ~/venv. Enable it for Mac/Linux unix users . ~/venv/bin/activate Enable it for Windows users ~/venv/bin/activate.ps1 May need to replace "bin" with "scripts" in some cases.

I didn't understand it at all but i LOVE It

./setup.sh. doesnt work and ask to use pipx install but I don't know how to do it ? anyclue ?

Installing now.

Everything sounds so exciting until you see the installation process and the missing UI afterwards. Than the reaction is just "meh"

This is great, congrats for the video, but I have some doubts concerning how to ask first you write pbpaste | fabric --pattern extract_wisdom and then you write pbpaste | analize_claims --stream, what I mean, when to use fabric command, when to put pipes, etc. Thanks

Just FYI, the pbcopy / pbpaste is a MacOS exclusive, but still super userful.

Unsolicited shortcut: For selecting all of a transcript, you can use the "End" key, after highlighting the beginning and it will highlight all of the transcript. Use the "Home" key after highlighting the bottom.

When i have enough fabric can i make a blanket?

this kind of ai is going to be killer stuff for everyday use, needs to be packaged a little easier though. early days yet.

can you make a video of this with groq?

The zsh error happened because of the poetry setup. Either the script didn't force the newline or it was manually edited, there wasn't one put in.

Interesting. I just want an LLM that can load my entire Java Spring Boot project. Even with doing @workspace command with github copilot its not able to keep track of context. LLMs are getting a lot better but I will be amazed when I can walk it through how I want my website to function and it gives me project wide solutions like update xyz file with this and that code.

Just a few seconds into the video - I think the solution to your screwed up Python environment, or to not screw it up in the first place, is to use a virtual Python environment for each project?! For me, on Debian 12, that's almost the only solution to not having to constantly read that pip is about to break the systems apt packages.

Regarding the error missing "ts". Remember you can put the error message into an LLM and resolve it.

Are there any open source or close source large action models? I'm not able to find any

It looks promising but I’ll wait for a UI.

Sooo just to check i could just lift these prompts and use them anyway i like without the nightmares of installing fabric? Perhaps it should just be a free prompt library???

I've had some thoughts about whether something like this would exist. I wonder how they eval prompts and if there's any mechanism that might dynamically determine prompt effectiveness.

Just seems like a prompt creator, no?

So this is some kind of prompt software that API's gpt4?

How do we use this tool to continue the conversation? For example, we might have a directive to respond to a certain type of follow-up prompt. Maybe we have a directive to respond to the user with follow-up clarification questions, etc.. How would we do this from the CLI? Or do we need to use this in a different manner (assuming what I am asking about is possible).

Hi Matthew, always thankful for your Content, but could you please first give some Showcase of the solution, so we can know if it is worth spending time for this?

Wisdom, what does "to extract all the wisdom" mean, like a categorized summary?

next: how to use it to generate images, running all locally

Elon says they are open sourcing grok this week, exciting.

Is there a way to change the GPT model this tool is trying to access? Currently, it is looking for GPT-4 turbo preview, which results in an error. I have an OpenAI account with some money in it.

Fabric is basically, Metaprompts in the backend.

is this installation for mac ? because i'm getting this error: The term 'git' is not recognized as the name of a cmdlet, function, script file, or operable program.

Can someone tell me which programming should I learn first in order to do all these ai stiff. I also want to understand what I am doing and not just copy paste everything. Thanks in advance.

Can Fabric be used without any API keys? Or are there any free models to try it out?

The majority of Python related AI projects don’t work on my system. I can’t imagine I’m the only one. Even he had issues just getting Poetry to work. Why do Python devs put up with this?

Thanks for this. Tried to install this before, but it failed. - Still the same issue on windows when trying to run ./setup.sh. running it from terminal it pops-up another terminal very quickly and closes. Can't continue the steps after that since nothing is working.

What do you do if you use windows with no pbpaste?

Can it automate local pc tasks i run everyday?

Does it work with others or only chatGPT?

Error while cloning the code Fetch-pack: unexpectedly disconnect while reading sideband packet Fatal: early EOF I repeat same method it still give me this error Any help?

Hi @MatthewBerman, thanks for the video.. it looks like fabric gonna end up being a "swiss knife" AI tool. I am having problems setting it up/installing it on ubuntu on my Windowss 11 PC. Everything worked well until I get to running: fabric --setup I get an error message that says "fabric: command not found". I have tried looking for a solution online, but found none. It will be greatly appreciated if you can spare a few minutes of you busy time to help resolve this. P.S. If anyone else has the solution to this problem, I welcome their guidance!

It's like a collection of python scripts+prompts for a collection of specific use cases but so far not very impressive. There are much more interesting things out there evolving like people making easy user interfaces for langchain. I would love if all this people collaborated to improve and accelerate together their "life automation" tools but we don't live in a perfect world.

it is unclear how you analyzed a video from the command line, considering the prompt is designed to work with text...

You should consider keeping all important info like the terminal views with in the title safe of the screen. I can’t follow your tutorial when you are using the cli.

How can us Linux users do pbpaste? Can you recommend another way to get this functionality in a Linux terminal?

How much ram required?

How can we use Google Gemini API with this?

🎯 Key Takeaways for quick navigation: 00:00 🛠️ *Installing Fabric and Understanding its Use Cases* - Fabric is an open-source project designed to solve everyday problems using AI. - Fabric serves as a library of tried and true prompts generated and reviewed by the community. - Use cases of Fabric include extracting interesting parts of videos, writing essays, summarizing academic papers, creating AI art prompts, and more. 01:12 🔄 *Installing Poetry and Setting up Fabric* - Install Poetry by running the provided command in the terminal. - Run the setup script to initialize Fabric. - Restart the shell or open a new terminal tab to apply changes. 03:13 🛠️ *Setting Up Fabric and Exploring Terminology* - Configure Fabric by providing the GP4 API key using the setup command. - Explore Fabric's terminology: mill, pattern, stitch, and loom. - Use the fabric CLI to list available patterns and understand their functionality. 05:04 📚 *Extracting Wisdom from Content* - Use Fabric's pattern to extract wisdom from content like videos or articles. - The "extract wisdom" pattern retrieves key ideas, quotes, facts, references, and recommendations. - Analyze claims and receive an overall score based on the extracted wisdom. 06:37 📊 *Analyzing Claims and Concluding* - Fabric can automatically analyze claims extracted from content and provide supporting evidence or refutations. - Each claim is scored, providing insight into its credibility. - Fabric offers a comprehensive solution for leveraging AI to enhance various tasks. Made with HARPA AI

On Mac, to install fabric, the "./setup.sh" did not work. But "pipx install ." worked.

I want to create a common workspace so I can review, comment, and approve articles before posting on social networking platforms. Does anyone have any suggestions for a gifclone for this?

Sorry guys for interupt you by commenting sth not related to this video, but I suddenly seen some weird case for using gemini pro 1.0 and GPT 4 in ChatGPT The case is: I have some unreadable pdf which contain text, but none of any tool can extract the text inside it as it is image of an word, then convert to pdf file. I tried to screenshot the file, then give to both gemini and GPT 4 to OCR and something weird happened: 1. Gemini refuse to give me the extracted text (I only need extracted text only). Try many time but the same result, it refuse that it cannot assist with this 2. GPT 4 give me the wrong OCR. It performed good at the first few pic, but after that, it happen in 2 case: 1. It give me the wrong content for extracted text, some part seem to be hallucination. 2. The second is totally wrong text: The right text is: "Because of the firm's working capital management pratices are affected by...". Instead, it gave me "The firm’s working capital management practices are influenced by...". Somehow, in this case it start to recognize something and give me totally wrong text, but the same meaning Have anyone seen this before? How can we control the LLM behavior in this case? It seem pretty weird, cuz my instruction is extract the text only, it did very good at the start, as the conversation start to increase, somehow the best model lost its attention

I cannot see any automation, these functions can be performed by a custom GPT, did I miss something?

Please make a video on the BitNet paper from Microsoft! 1 bit llms

Fabric vs OpenDevin vs Devika - What's better?

Screen shot desktop every 3 seconds into jpg feed in llava. It has vision !!! 😂

./setup.sh didn't work at all (not recognized as external or internal command). typing just 'setup.sh' without the './'' brings up a window that opens and closes way too fast for me to see it, aside from that... nothing. pipx install after that does nothing, typing 'fabric -h' is not recognized.

Windows holds 72% of the market share. Please do this for Windows:)

you need a RTX 30 or 40 to run it locally?

Actually to install fabric: you need a needle! Admit it... Thats a really good point

Why are we going in reverse direction? Such tools increasing complexities

Don’t say you’ll revoke the key and let them suffer

I have had to take a step back from these projects. Too messy that even pinokio won't install/run. Even after attempting to uninstall, deleting files and registry keys

When I do fabric -h it doesn’t work

Why can't stuff just be written in c(++) again, with low deps, and (c)make files...

Is there a feature to help handicapped people? APPS for PC?

Fabric is right: over-simplification sum up pretty much your approach to AI

First. Fix me plz 😂

it is not clear by the author how to use it with a local AI like llama. did you find it?

Does it support Gemini API??

In my view you should ditch conda and live with pyenv+poetry.

Wth do you need this complex method to optimize prompts? With an 8k context window you can litterally create a custom GPT for this without using knowledge files.

anyone could integrate it with local ollama?

so its just... a list of prompts?

Nerds unite!

Any opinions ..they add Larry Summer to the board .... ridiculous