Maid is an cross-platform free and open source application for interfacing with llama.cpp models locally, and with Ollama, Mistral, Google Gemini and OpenAI models remotely.
Maid supports sillytavern character cards to allow you to interact with all your favorite characters.
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
Maid utilises git submodules extensively. To clone the repository, use the following command:
git clone --recursive https://github.com/Mobile-Artificial-Intelligence/maid.gitTo install the dependencies on fedora based systems, use the following command:
sudo dnf install -y cmake ninja-build pkg-config gtk3-devel vulkan-develTo install the bdependencies on debian based systems, use the following command:
sudo apt-get install -y cmake ninja-build pkg-config libgtk-3-dev libvulkan-devWindows, Linux, Android. Releases page. MacOS and IOS Releases not available at this time.
| Parameter | Local | Ollama | OpenAI | MistralAI |
| model | Y | Y | Y | Y |
| seed | Y | Y | Y | Y |
| temperature | Y | Y | Y | Y |
| responseFormat | N | Y | Y | N |
| numKeep | N | Y | N | N |
| numPredict | N | Y | N | N |
| topK | Y | Y | N | N |
| topP | Y | Y | Y | Y |
| tfsZ | Y | Y | N | N |
| typicalP | Y | Y | N | N |
| repeatLastN | Y | Y | N | N |
| repeatPenalty | Y | Y | N | N |
| presencePenalty | Y | Y | Y | N |
| frequencyPenalty | Y | Y | Y | N |
| stop | N | Y | Y | N |
| mirostat | Y | Y | N | N |
| mirostatTau | Y | Y | N | N |
| mirostatEta | Y | Y | N | N |
| penalizeNewline | Y | Y | N | N |
| numa | N | Y | N | N |
| numCtx | Y | Y | N | N |
| numBatch | Y | Y | N | N |
| numGqa | N | Y | N | N |
| numGpu | N | Y | N | N |
| mainGpu | Y | Y | N | N |
| lowVram | N | Y | N | N |
| f16KV | N | Y | N | N |
| logitsAll | Y | Y | N | N |
| vocabOnly | Y | Y | N | N |
| useMmap | Y | Y | N | N |
| useMlock | Y | Y | N | N |
| embeddingOnly | Y | Y | N | N |
| ropeFrequencyBase | Y | Y | N | N |
| ropeFrequencyScale | Y | Y | N | N |
| numThread | Y | Y | N | N |
| maxTokens | N | N | Y | Y |
| n | N | N | Y | N |
| logitBias | Y | N | Y | N |
| functions | N | N | Y | N |
| functionCall | N | N | Y | N |
| user | N | N | Y | N |
| safeMode | N | N | N | Y |
- Write code comments
- Documentation
- Testing and Building on MacOS and IOS
- Spreading the word
Android version tested on a Oneplus 10 Pro 11gb phone. Also tested on Fedora Linux, Windows 11. Tested with calypso 3b, orcamini 3b, llama 2 7B-Chat, llama 7B and many more.