CloakPipe – Privacy proxy for LLM and RAG with consistent pseudonymization

Summary: CloakPipe is a Rust-based privacy proxy that detects and replaces PII with consistent pseudonyms in under 5ms, forwarding sanitized requests to LLMs and rehydrating responses instantly. It operates as a single binary with AES-256 encryption and stores no raw PII.

What it does

CloakPipe intercepts data sent to LLMs, detects PII, replaces it with pseudonyms using CloakTree, and rehydrates responses via SSE, ensuring data privacy with minimal overhead.

Who it's for

It is designed for developers and organizations using LLMs and RAG workflows requiring privacy and pseudonymization of sensitive data.

Why it matters

It prevents raw PII from reaching LLMs, maintaining data privacy and compliance in AI-driven applications.