ZINC: Supercharging AMD GPUs for Local LLM Inference

A new inference engine called ZINC, written in Zig, is poised to revolutionize local running of Large Language Models on AMD GPUs. It addresses the current limitations in existing solutions, offering a streamlined approach that optimizes performance and resource utilization. This project demonstrates a dedication to unlocking the full potential of AMD hardware for Generative AI applications.