Software

Graphical user interface (GUI)

• GPT4All - easy start for offline use
• LM Studio - easy start for offline work with LLMs
• FlowiseAI - open source low-code tool for developers to build customized LLM orchestration flow
• KoboldAI UI

Development

• AutoGen - a programming framework for agentic AI
• llama.cpp - LLM inference in C/C++
• node-llama-cpp - llama.cpp for Node.js
• LocalAI - open-source alternative to OpenAI
• ollama - CLI and REST API
• LangChain - LLM framework
• LangGraph Studio
• Semantic Kernel - is an SDK that integrates Large Language Models (LLMs)
• NLTK - Natural Language Toolkit

Database Management System (DBMS)

• Apache Parquet - is an open source, column-oriented data file format designed for efficient data storage and retrieval
• Chroma - is the open-source AI application database
• Faiss - a library for efficient similarity search and clustering of dense vectors
• Qdrant - is an Open-Source Vector Database and Vector Search Engine written in Rust