Self-Hosting Tools

• Jan: Self-Hosted / Discord / GitHub
• LM Studio: Self-Hosted / Discord / GitHub
• llama.cpp: Self-Hosted Transformer-Based LLMs
• KoboldCpp: llama.cpp with API + GUI / ROCm / Colab
• oobabooga: Self-Hosted Models / Colab / Subreddit / Discord
• Aphrodite Engine: Serve LLMs at Scale with Kobold & OpenAI APIs / Colab / GitHub
• Petals: Self-Hosted / Discord / GitHub
• Leon: Self-Hosted / Discord / GitHub
• Ollama: Self-Hosted / Discord / GitHub
• LoLLMs Web UI: Self-Hosted
• AnythingLLM: Self-Hosted / Discord / GitHub
• LibreChat: Self-Hosted / Discord / GitHub
• GPT4All: Self-Hosted / Discord / GitHub
• llamafile: Run LLM with Single Files / Discord
• LLM-API-Key-Proxy: LLM API Key Proxy