llama.cppggml-org/llama.cpp
LLM inference in C/C++ on CPUs and GPUsPersonalLocal inferenceCLILibrary / SDK★ 130kMITcommit 21 minutes ago86worth
Open-source AI and LLM tools: chat interfaces, agent frameworks, local model runners, RAG pipelines, coding assistants and evaluation suites.