Run DeepSeek models on your own machine and interact with them using MATLAB

Generative AI
Segui


Run DeepSeek models on your own machine and interact with them using MATLAB

Mike Croucher il 4 Feb 2025
Ultime attività Replicato da Mike Croucher il 4 Feb 2025

You've probably heard about the DeepSeek AI models by now. Did you know you can run them on your own machine (assuming its powerful enough) and interact with them on MATLAB?
In my latest blog post, I install and run one of the smaller models and start playing with it using MATLAB.
How to run local DeepSeek models and use them with MATLAB » The MATLAB Blog - MATLAB & Simulink
Larger models wouldn't be any different to use assuming you have a big enough machine...and for the largest models you'll need a HUGE machine!
Even tiny models, like the 1.5 billion parameter one I demonstrate in the blog post, can be used to demonstrate and teach things about LLM-based technologies.
Have a play. Let me know what you think.

2 Commenti

Accedi per partecipare
David
David il 4 Feb 2025
For comparison, I can run the 14b parameter distilled model just fine on my M1 Mac with 16 gigs of RAM.
Mike Croucher
Mike Croucher il 4 Feb 2025
Nice! I'll try that next
Mike Croucher

Mike Croucher

I write The MATLAB Blog at MathWorks and specialize in High Performance Computing, Research Software Engineering and Machine Learning. You can also follow me at BlueSky https://bsky.app/profile/walkingrandomly.bsky.social
26
Pubblicas
226
Replicas
40
Seguaci
Segui
Visualizza il profilo

Post di questo autore

Guarda tutto

Tag

Non è stata ancora inserito alcun tag.

Go to top of page