Yule – Secure local AI runtime with verifiable inferences

Summary: Yule is a pure Rust local AI runtime that avoids C++ and CUDA dependencies. It uses Merkle verification for tensors and Ed25519 signatures for every inference, sandboxing the model process for enhanced security and providing proof of which model generated each response.

What it does

Yule parses GGUF models and runs them locally using 12 Vulkan compute shaders for GPU acceleration without NVIDIA lock-in. It sandboxs the model process and cryptographically signs each inference to ensure integrity.

Who it's for

Developers and businesses needing a secure, verifiable local AI runtime without C++ vulnerabilities or proprietary GPU dependencies.

Why it matters

It addresses security flaws in existing C++ runtimes by providing a sandboxed, cryptographically verifiable AI inference environment.