Software
Graphical user interface (GUI)
- GPT4All - easy start for offline use
- LM Studio - easy start for offline work with LLMs
- FlowiseAI - open source low-code tool for developers to build customized LLM orchestration flow
- KoboldAI UI
Development
- llama.cpp - LLM inference in C/C++
- node-llama-cpp - llama.cpp for Node.js