gpt4all
by Various
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Apps
gpt4all
Added 1 June 2026
Overview
GPT4All is an open-source framework that runs large language models locally on consumer hardware without requiring cloud APIs. Built in C++, it bundles quantized model weights and inference engines to enable LLM inference on CPU-only machines, laptops, and edge devices. Available for commercial use under permissive licensing.
Best for
Best for
Developers building offline-first applications or deploying LLMs on consumer hardware without cloud infrastructure.
Use cases
- Running LLMs offline without API costs or internet dependency
- Deploying models on resource-constrained devices like laptops or Raspberry Pi
- Building private applications where model data cannot leave the device
Notes
GPT4All is an open-source framework that runs large language models locally on consumer hardware without requiring cloud APIs. Built in C++, it bundles quantized model weights and inference engines to enable LLM inference on CPU-only machines, laptops, and edge devices. Available for commercial use under permissive licensing.
77,348 stars on GitHub. Last updated 2025-05-27. Licensed MIT.
Use cases
- Running LLMs offline without API costs or internet dependency
- Deploying models on resource-constrained devices like laptops or Raspberry Pi
- Building private applications where model data cannot leave the device
Pros
- Runs on CPU-only hardware with no GPU required
- Open-source with commercial license permitting production use
- No external API calls or cloud dependency
Cons
- Inference speed significantly slower than GPU-accelerated alternatives
- Model quality limited to quantized versions, trading accuracy for size
- Requires manual model selection and management by the user
Indexed from awesome-generative-ai and enriched against its public facts.
Pros
- Runs on CPU-only hardware with no GPU required
- Open-source with commercial license permitting production use
- No external API calls or cloud dependency
Cons
- Inference speed significantly slower than GPU-accelerated alternatives
- Model quality limited to quantized versions, trading accuracy for size
- Requires manual model selection and management by the user
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
create-t3-turbo-ai
Community
Build full-stack, type-safe, LLM-powered apps with the T3 Stack, Turborepo, OpenAI, and Langchain
llama.cpp
Community
LLM inference in C/C++
Shell-Pilot
Community
A simple, lightweight shell script to interact with OpenAI or Ollama or Mistral AI or LocalAI or ZhipuAI from the terminal, and enhancing intelligent system management without any
AI Dungeon
Various
A text-based adventure-story game you direct (and star in) while the AI brings it to life.
Grok
Various
An LLM by xAI with [open source](https://github.com/xai-org/grok-1) and open weights. #opensource
LLM
Various
LLM: A CLI utility and Python library for interacting with Large Language Models
LLaMA
Various
Llama LLM, a foundational, 65-billion-parameter large language model by Meta. Meta, February 23rd, 2023. #opensource
Unsloth
Various
Unsloth is an open-source, no-code web UI for training, running and exporting open models in one unified local interface.
TurboPilot
Various
Turbopilot is an open source large-language-model based code completion engine that runs locally on CPU
ChatGPT
OpenAI
General-purpose AI assistant for writing, coding, analysis, and conversation. The most widely deployed consumer AI product.
Forefront
Various
Forefront is a platform to fine-tune and inference open-source-language-models.
Jan
Various
Jan is an open-source alternative to ChatGPT. Run open-source AI models locally or connect to cloud models like GPT, Claude and others.
LibreChat
Various
LibreChat brings together all your AI conversations in one unified, customizable interface.
llama.cpp
Various
LLM inference in C/C++
LLM
Various
LLM: A CLI utility and Python library for interacting with Large Language Models
LM Studio
Various
Run local AI models like gpt-oss, Llama, Gemma, Qwen, and DeepSeek privately on your computer.
OpenAI API
Various
Announcement of the OpenAI API for text-to-text general-purpose AI models based on GPT-3. OpenAI blog, June 11, 2020.
Poe
Various
Poe gives access to a variety of bots.
privateGPT
Various
Interact with your documents using the power of GPT, 100% privately, no data leaks
PyGPT
Various
PyGPT is an open‑source desktop AI assistant for Windows, macOS and Linux. Chat, agents, web search, run Python, TTS/STT, plugins, long‑term memory.
Unsloth
Various
Unsloth is an open-source, no-code web UI for training, running and exporting open models in one unified local interface.
Vicuna-13B
Various
We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge s
Z.ai
Various
Meet Z.ai, your free AI-powered assistant. Build websites, create slides, analyze data, and get instant answers. Fast, smart, and reliable, powered by GLM-5.