Turn websites into LLM-ready data
DataFuel API scrapes entire websites and knowledge bases in a single query. Get clean, markdown-structured web data instantly for your RAG systems and AI models. No complex scraping code needed.
The DataFuel API is documented using the OpenAPI specification. This allows for a standardized and detailed description of our API endpoints, request/response structures, and authentication methods. Below, you’ll find a link to our OpenAPI specification file, which provides a comprehensive overview of the API.
Use the /scrape endpoint to initiate a web scraping job
Use the /crawl endpoint to recursively scrape an entire website or domain
Use the /get_scrapes endpoint to get metadata and signed URLs for your scrapes
All API endpoints are authenticated using Bearer tokens and picked up from the specification file.