← Agent Data Hub · Search endpoints · /llms.txt
Fetches any public webpage URL, strips scripts/styles/navigation noise, and converts the core content into token-efficient Markdown for AI agents.
GET https://api.agentdatahub.de/api/v1/call/web-url-to-llm-markdown-fetch?url=https://example.com&compact=1
Full metadata: without compact=1 · Markdown: format=llm · Only some fields: add &fields=a,b.c · MCP: tool call_api with {"apiId":"web-url-to-llm-markdown-fetch"}
url | Target HTTPS URL (default: https://example.com) |
{
"apiId": "web-url-to-llm-markdown-fetch",
"data_freshness": "live",
"data": {
"url": "https://example.com/",
"http_status": 200,
"title": "Example Domain",
"raw_html_bytes": 577,
"html_truncated_for_conversion": false,
"clean_markdown_chars": 172,
"estimated_llm_tokens": 43,
"ssrf_verified_public_host": true,
"markdown": "Example Domain \nThis domain is for use in documentation examples without needing permission. This is not a service; avoid relying on it for testing and monitoring purposes."
},
"source": "100% Platform Live Web-to-Markdown Engine",
"license": "100% Platform Owned Compute"
}
| Source | 100% Platform Live Web-to-Markdown Engine |
| License | 100% Platform Owned Compute |
| Source URL | https://example.com |
| Terms | https://localhost:3000/llms.txt |
| Category | AI Models, Cloud & Cybersecurity › 1. Web Retrieval & Agentic Inspection |