Serge Aurubin

SERGE AURUBIN

DATA SCIENTIST

Welcome to my blog for everything having to do with data science and analysis. I am always looking for new opportunities to drive business insight using data analysis.

Data & Analytics
  • Data Analysis
  • Power BI
  • Excel
  • Data Pipelines
  • Matillion
Engineering
  • Software Developer
  • Python
  • PHP
  • ReactJS
  • Flutter
  • Front End Dev
  • Back End Dev
Databases
  • MySQL Dev/DBA
  • Oracle DBA
Cloud & AI
  • Amazon Web Services
  • Docker
  • Kubernetes
  • Git
  • Artificial Intelligence
  • Claude
  • OpenAI
Back to Videos

Run an AI Large Language Model (LLM) at home on your GPU

mCoding

August 14, 2024   1

Download Docker Desktop: https://dockr.ly/46NkFOJ
This video is sponsored by Docker. https://www.docker.com/

Large Language Models (LLMs) are a type of AI model that have proven to be extremely powerful and useful for a wide variety of tasks. They may be "large" in the sense that they use billions of parameters, but that doesn't mean you need to be a big company in order to run one. In fact, you can run some of the latest and greatest LLMs on your own machine, on your GPU, completely for free. We'll see how to do all that and more in this video using Docker Desktop! We'll even write an app to detect YouTube comment spam using an LLM.


― mCoding with James Murphy (https://mcoding.io)

Docker: https://www.docker.com/
Ollama: https://ollama.com/
Ollama Docker image: https://hub.docker.com/r/ollama/ollama
Ollama Python: https://github.com/ollama/ollama-python
GPU compatibility: https://developer.nvidia.com/cuda-gpus

Docker Tutorial Video: https://youtu.be/b0HMimUb4f0
Fast Pow algorithm Video: https://youtu.be/GrNJE6ogyQU
YouTube Data API Video: https://youtu.be/0F9sdRtbwkE

Source code: https://github.com/mCodingLLC/VideosSampleCode

SUPPORT ME ⭐...

0 Comments

No comments yet. Be the first to weigh in.

Back to Videos

Login