BitNet
microsoft/BitNetInference framework for 1-bit LLMs
PersonalEnterpriseLocal inferenceLibrary / SDKPermissiveAbout
Microsoft's official runtime for fast 1-bit models on CPUs.
From the repository: “Official inference framework for 1-bit LLMs”
Inference framework for 1-bit LLMs
PersonalEnterpriseLocal inferenceLibrary / SDKPermissiveMicrosoft's official runtime for fast 1-bit models on CPUs.
From the repository: “Official inference framework for 1-bit LLMs”