AnythingLLM
All-in-one local AI application that provides ChatGPT-like features (document chat, AI agents, automations) using local models. Built and maintained by Tim Carambat.
Capabilities
- Chat with documents
- AI agents and automations
- Meeting assistant — listens to and summarizes Zoom/Teams calls in real time; also accepts drag-and-drop audio files
- Prioritizes local model inference (no cloud required)
Relevance to This Wiki
AnythingLLM is the primary tool that benefits from TurboQuant. Its meeting assistant requires ~32K+ context to summarize long recordings (a 3-hour podcast = ~48K tokens). TurboQuant makes this feasible on consumer hardware that previously could only handle 8K context.