Transformers now runs llama.cpp quants

What is the GGUF file format? Load GGUF with transformers Serve GGUF with your preferred interface Benchmarking against llama.cpp transformers and llama.cpp Beyond GGUF: ggml kernels for more models Fast local inference with Python and PyTorch Reusing ggml's Metal kernels Keeping the CPU and GPU working together...