AnythingLLM

AnythingLLM is a free, private AI assistant that runs on a user's computer without accounts, API keys, token limits, or cloud processing. It supports document knowledge bases, web scraping and search, model selection, background jobs, custom agent skills, and workflow building.

The desktop app is available for macOS, Windows, and Linux. It can transcribe and summarize meetings locally, generate action items and transcripts, and provide on-device dictation, text refinement, and context-aware answers. Users can select a model or let the app recommend one based on their hardware.

AnythingLLM is open source under the MIT license and can also be self-hosted for multi-user deployments. A custom tool builder and developer API are available for extending the system.

Highlights

• Runs locally on macOS, Windows, and Linux
• Creates document-based knowledge bases without sending data off-device
• Includes meeting transcription, summaries, action items, and full transcripts
• Supports custom agent skills, workflows, and a developer API
• Open source under the MIT license