llama.cpp Articles

Android On-Device Inference with GGUF and llama.cpp

A practical walkthrough for porting and tuning llama.cpp with GGUF to run a 7B model on a Snapdragon 8 Gen 2 phone.