llama.cpp Portable LLM Inference Engine in C/C++

llama.cpp is a high-performance C/C++ implementation for running LLM inference across diverse hardware. It supports GGUF model quantization, GPU acceleration on NVIDIA, AMD, and Apple Silicon, and provides both a CLI and an OpenAI-compatible HTTP server for local model serving.