Skip to content
Hallway
0:00 / 0:00

#mixtral#ollama#mistral

This new AI is powerful and uncensored… Let’s run it

Fireship

4.3M subscribers • 26 videos on Hallway

YouTube
  • Recommended by 2 people: 2 in engineering communities.
  • Linked in the descriptionjmorganca/ollama
  • May be out of date. The tools, versions or practices it shows have likely moved on.

Intermediate. Assumes working knowledge.

2.9M views2 years ago2 recommendations

AI and machine learningTransformers and LLMsTraining and serving models

Jeff Delaney explains how to run Mistral's Mixtral 8x7B model locally using Ollama and how to fine-tune it with custom data.

Learn how to run Mistral's 8x7B model and its uncensored varieties using open-source tools. Let's find out if Mixtral is a good alternative to GPT-4, and learn how to fine tune it with your own data. #ai #programming #thecodereport 💬 Chat with Me on Discord discord.gg/fireship 🔗 Resources Mixtral 8x7b mistral.ai/news/mixtral-of-experts/ Uncensored AI models erichartford.com/uncensored-models Ollama Github github.com/jmorganca/ollama Grok AI breakdown youtu.be/CgruI1RjH_c?si=lgkIAs-LbW1VypXv 🔥 Get More Content - Upgrade to PRO Upgrade at fireship.io/pro Use code YT25 for 25% off PRO access 🎨 My Editor Settings - Atom One Dark - vscode-icons - Fira Code Font 🔖 Topics Covered - Mixtral 8x7B explained - How to run Mistral models locally - Best ChatGPT alternatives - What is a mixture of experts AI model? - How do you fine tune your own AI models?

Why it's here

2 people recommend this

What people say. Recommended as a guide on creating and training custom LLMs on your own dataset.

Moments people linked to

u/HarderFasterHarderin r/C_Programming • Recommends

On “Any code assistants on existing code bases for the casual C programmer ?”

The post above is an awesome answer, wish I had more thumbs to give... To put some numbers on it, I recently saw a (video)[video on creating your own LLM trained on your own dataset (could be the project + Linux headers). Takes 3 days on the cloud and about $1,200 for a smallish dataset. So it's doable, but seems like a custom LLM for the project is a bit out of the budget for a one man show (unless of course you are independently wealthy 🤑).Whether you buy GPUs in the cloud or roll your own training server. The other option is to make some videos of it and try to get a bunch of cyber-hipsters to think it's the new dwm for that least-bloated roll your own Unix setup. Then you have a bu…
2View on Reddit

u/MySpermIs-Unvaxxd-01in r/compsci • Recommends

This new AI is powerful and uncensored… Let’s run it removed
1View on Reddit