About
Layer-by-layer inference that lets large models run on small GPUs.
From the repository: “AirLLM 70B inference with single 4GB GPU”
Layer-by-layer inference that lets large models run on small GPUs.
From the repository: “AirLLM 70B inference with single 4GB GPU”