Web datafor AI agents
Built for developers with focus on precision, speed, and simplicity.
1import Olyptik from 'olyptik';23const olyptik = new Olyptik({ apiKey: 'YOUR_API_KEY' });45await olyptik.runCrawl({ startUrl: 'https://example.com', maxResults: 30 });Output that speaks RAG fluently
Our default configuration is designed to give you the best possible results for RAG pipelines. Get clean markdown and LLM-ready content optimized for vector databases and semantic search.
One size fits all*
(*but we secretly custom-fit it just for your site). No need to configure a thousand props for each inidivdual website.
Oh, and it's lightning fast
Blazing fast crawling speeds, designed by un-patiant developers.
AI extraction
Instruct AI to control and focus your crawls to extract exactly the content you need.
Rotating proxies
Built-in proxy rotation ensures reliable crawling without rate limits or IP blocks.
Dynamic content
Full JavaScript rendering support to capture content from modern single-page applications.
Real-time logs
Monitor your crawls in real-time with detailed logs and progress tracking.