Create Training Data for Finetuning LLMs 

🚀 Mastering LLM Fine-Tuning: From PDFs to JSONL Files🚀
Welcome to APC Mastery Path! In this comprehensive tutorial, we dive deep into the process of creating training data for fine-tuning Large Language Models (LLMs). We'll guide you through extracting text data from PDFs using the powerful `marker-pdf` Python library, cleansing the resulting markdown, and converting it into a JSONL format ready for LLMs.
🔔Agenda:
00:08 Intro
00:59 Part 1: Main concept of the solution
01:50 Part 2: Marker PDF Package Overview & Installation
05:46 Part 2-1: Single File Conversion
08:29 Part 2-2: Multiple File Conversion & Conversion to JSONL format
15:03 Part 3: Finetuning LLMs using extracted data
22:01 Outro
At APC Mastery Path, we offer bespoke mentoring and teaching packages to RICS APC candidates. Enhance your APC journey with our expert guidance and tailored support.
Don’t forget to subscribe, like, and share! Let’s embark on this LLM fine-tuning journey together! 🚀✨
🔗 General Links & Resources:
⚫Our Website: www.apcmasterypath.co.uk
⚫All APC Mastery Path Blogposts: www.apcmasterypath.co.uk/blog...
⚫Personal Linkedin Page: / mohamed-ashour-0727
⚫APC Mastery Path Linkedin Page: / apc-mastery-path
📽️Useful videos:
⚫Finetune your LLMs on custom datasets using Unsloth: • Finetune Your LLM on C...
⚫Deploy Open WebUI with Zero Coding Skills : • Unlocking Local AI: De...
📝Prerequisites & Dependencies:
⚫Nvidia Cuda Toolkit v 12.1: developer.nvidia.com/cuda-12-...
⚫Windows subsystem for Linux : learn.microsoft.com/en-us/win...
⚫Anaconda for Linux: repo.anaconda.com/archive/Ana...
⚫ Pytorch: pytorch.org/
⚫Ollama : www.ollama.com/download
⚫Docker: desktop.docker.com/win/main/a...
⚫Open WebUI on Github: github.com/open-webui/open-webui
📚Github & Huggingface repositories:
⚫Unsloth available LLMs: huggingface.co/unsloth
⚫Marker PDF on GitHub: github.com/VikParuchuri/marker
⚫Unsloth GitHub Repository: github.com/unslothai/unsloth?...
#LLM #MachineLearning #DataScience #AI #Python #PDFConversion #JSONL #MarkerPDF #FineTuning #APCMasteryPath #RICSAPC #Mentoring #Education #TechTutorials

Наука