Fine-tuning LLM on your laptop: VRAM vs Shared Memory vs GPU Load, Performance Considerations

I have been playing with Supervised Fine Tuning and LORA using my laptop with NVIDIA RTX 4060 8GB. The subject of SFT is vast, picking the correct training hyperparams is more magic than science, and there’s a good deal of...

April 8, 2024

Compared Effect Of Image Captioning For SDXL Fine-tuning / DreamBooth Training for a Single Person, 10.3 GB VRAM via OneTrainer

Development News

Compared Effect Of Image Captioning For SDXL Fine-tuning / DreamBooth Training for a Single Person, 10.3 GB VRAM via OneTrainer

Check all the images below to see used training dataset and used captionings. All trainings are done on OneTrainer Windows 10 with newest 10.3 GB Configuration : https://www.patreon.com/posts/96028218 A quick tutorial for how to use concepts in OneTrainer : https://youtu.be/yPOadldf6bI...

March 28, 2024

Fine-Tuning Fundamentals – Generative AI For Beginners (v2)

Development News

Fine-Tuning Fundamentals – Generative AI For Beginners (v2)

3 Resources to Jumpstart Your Generative AI Journey: Generative AI for Beginners Curriculum Build Generative AI Apps Code-First With Azure AI Responsible AI Resources For Developers Welcome to the sixth post in my This Week in AI News series! Today,...

March 1, 2024

one of the Codia AI technologies: Large Language Models from Pre-training to Fine-tuning

Development News

one of the Codia AI technologies: Large Language Models from Pre-training to Fine-tuning

1. Introduction The articles ‘Codia AI: Shaping the Design and Code Revolution of 2024‘ and ‘Codia AI: Shaping the Design and Code Revolution of 2024 – Part 2‘ introduce Codia AI, which possesses its own AI models. In the field...

February 18, 2024

Development News

Fine-Tuning LlaMa 2 on Custom Data!

Large Language Models (LLMs) are advanced artificial intelligence systems designed to understand and generate natural language text. They are trained on extensive datasets of text from the internet including books, websites and articles, allowing them to learn language patterns, grammar...

February 14, 2024