Skip to content

Smartup7/Portable-AI-USB

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🔒 Portable Uncensored AI — Runs Entirely from a USB Drive

A fully private, portable, uncensored AI assistant that runs 100% from a USB flash drive. No internet needed after setup. No data leaves the USB. Works on both Windows and Mac.

📺 Watch the Tutorial

Portable AI USB Tutorial

⚡ What's Inside

Component Purpose
Dolphin 2.9 LLaMA 3 8B Uncensored AI model (~5.7 GB)
Ollama Lightweight AI engine that runs the model
AnythingLLM Beautiful chat interface

🚀 Setup (One Time Only)

What You Need

  • A USB flash drive with at least 16 GB of free space (32 GB recommended)
  • Format the USB as exFAT (works on both Windows and Mac)
  • An internet connection for the initial download (~6 GB total)

Steps

  1. Download this repo and copy ALL files to your USB drive
  2. Double-click install.bat on the USB drive
  3. Wait for everything to download (~15-30 minutes depending on internet speed)
  4. Done! Your portable AI is ready to use

▶️ How to Use

On Windows

  • Double-click start-windows.bat on the USB drive
  • The AnythingLLM chat window will open automatically
  • Keep the black terminal window open while chatting
  • Press any key in the terminal to safely shut down

On Mac

  • Double-click start-mac.command on the USB drive
  • First time: It will automatically download the Mac engine (~2 min)
  • The AnythingLLM window will open automatically
  • Press ENTER in the terminal to safely shut down

🔐 Privacy

  • Zero footprint — nothing is installed on the host computer
  • All AI data, chats, and settings stay on the USB drive
  • Works completely offline after initial setup
  • No telemetry, no cloud, no tracking

📁 USB Drive Structure (After Setup)

USB Drive/
├── install.bat             ← Run this first (one time only)
├── install-core.ps1        ← Setup script (called by install.bat)
├── start-windows.bat       ← Windows launcher
├── start-mac.command       ← Mac launcher
├── ollama/                 ← AI engine (Windows)
├── ollama_mac/             ← AI engine (Mac, auto-downloaded)
├── models/                 ← AI model files
├── anythingllm/            ← Chat interface app
└── anythingllm_data/       ← Your chats & settings (portable!)

⚠️ Important Notes

  • First launch on a new computer may take 30-60 seconds to load
  • The AI runs on your CPU — responses take 10-30 seconds depending on hardware
  • If you have a GPU, responses will be much faster
  • Always safely eject the USB before unplugging

📜 License

MIT License — See LICENSE for details.

About

A 100% offline, fully portable, zero-trace AI (Ollama + Llama 3 + AnythingLLM) that runs natively from a USB drive on Windows and Mac.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • PowerShell 49.2%
  • Shell 27.7%
  • Batchfile 23.1%