EdgeDox: Offline AI for Docs – Privacy-first AI document assistant running fully on-device

Summary: EdgeDox is an AI document assistant that operates entirely offline on Android devices, using on-device large language models (LLM) and embeddings powered by MNN. It enables users to chat with PDFs and documents, providing instant search, summarization, and question answering without sending data to the cloud.

What it does

EdgeDox runs LLM and retrieval-augmented generation (RAG) locally on mid-range Android phones, allowing users to interact with documents securely and privately. It processes PDFs and other documents offline using optimized and quantized on-device inference.

Who it's for

It is designed for users seeking private, offline AI document assistance on mobile devices without relying on internet connectivity or cloud services.

Why it matters

EdgeDox addresses privacy concerns by ensuring no data leaves the device while providing fast, accessible AI-powered document intelligence anywhere.