Dave installs Deepseek on a Jetson Orin Nano and a Threadripper and explores the self-hosted editions of Deepseek R1 and evaluates their performance on a wide range of hardware. Free Sample of my Book on the Spectrum:
Secrets of the Autistic Millionaire:
Watch ShopTalk Now on Dave's Attic:
Follow me on X:
Facebook:
Introduction to the Affordable NVIDIA Jetson Orin Nano Super: 00:00
Why Run AI Locally?: 00:31
Advantages of Self-Hosted AI: 01:02
Jetson Nano Specifications: 01:33
Setting Up DeepSeek R1 with Olama: 02:04
Privacy Benefits of Local AI: 03:06
Running Queries Locally: 03:57
Use Cases for Home Automation: 05:09
Cost-Effectiveness of Jetson Nano: 05:40
Reasoning Models vs Traditional LLMs: 06:42
7B Parameter Model Performance Review On Affordable Jetson Orin Nano: 8:53
Running the full DeepSeek-R1 671B on $10,000+ machine 9:20
Outro - 11:58