Gguf

whichllm is a CLI tool that automatically detects your hardware (GPU, CPU, RAM) and recommends the best local LLM models from HuggingFace that will...

Atomic Chat is a local-first desktop and mobile application that runs open-weight LLMs privately on users' machines with an OpenAI-compatible API...

Off Grid AI Mobile is a complete on-device AI suite for Android, iOS, and macOS that runs LLMs, image generation, vision AI, and voice transcription...

AutoRound is a specialized quantization toolkit for Large Language Models and Vision-Language Models, designed to achieve high accuracy at ultra-low...

llmfit is a terminal tool that matches LLM models to your specific hardware (CPU, RAM, GPU), providing scoring across quality, speed, fit, and...

Gollama is a terminal UI tool for managing Ollama language models on macOS and Linux, enabling users to list, inspect, delete, copy, and push models...

node-llama-cpp provides Node.js bindings for running large language models locally using llama.cpp, with support for GPU acceleration (Metal, CUDA,...

Shimmy is a pure-Rust, single-binary WebGPU inference engine that provides OpenAI-compatible API endpoints for running GGUF models locally without...

KitOps is a CNCF-governed open-source DevOps tool for packaging, versioning, and securely sharing AI/ML projects using OCI container technology. It...

Maid is a mobile application for Android that enables users to interact with large language models either locally via llama.cpp or remotely through...

llamafile packages LLMs and speech-to-text models into single-file executables that run locally without installation across multiple OS/CPU...

ComfyUI LLM Party is a specialized node framework that integrates large language models, voice synthesis, OCR, and multimodal capabilities into...

Handy-Ollama is a comprehensive Chinese-language tutorial for deploying large language models locally using Ollama on CPU-only hardware. It serves...