AI Agent Friendly SDK – Optimize websites for AI agents with semantic-dense Polish Markdown

Summary: This SDK crawls websites, removes unnecessary HTML, and converts content into semantic-dense Polish Markdown using Gemini 3.0. It also generates llms.txt files to enhance large language model (LLM) reasoning and improve AI agent readability.

What it does

The SDK automatically crawls a site, strips noisy HTML, and translates content into Polish Markdown based on research showing improved LLM reasoning. It includes llms.txt generation for AI agents.

Who it's for

Developers seeking to optimize their websites for AI agents rather than just human readers, especially those using Next.js.

Why it matters

It reduces content noise and increases semantic density, improving AI agents’ ability to understand and reason over website content.