> ## Documentation Index
> Fetch the complete documentation index at: https://docs.datafuel.dev/llms.txt
> Use this file to discover all available pages before exploring further.

# Introduction

> Turn websites into LLM-ready data

<Note>
  DataFuel API scrapes entire websites and knowledge bases in a single query. Get clean, markdown-structured web data instantly for your RAG systems and AI models. No complex scraping code needed.
</Note>

## Welcome

The DataFuel API is documented using the OpenAPI specification. This allows for a standardized and detailed description of our API endpoints, request/response structures, and authentication methods. Below, you'll find a link to our OpenAPI specification file, which provides a comprehensive overview of the API.

<Card title="DataFuel" icon="spider-web" href="api-reference/endpoint/scrape">
  Use the /scrape endpoint to initiate a web scraping job
</Card>

<Card title="Crawl" icon="spider" href="api-reference/endpoint/crawl">
  Use the /crawl endpoint to recursively scrape an entire website or domain
</Card>

<Card title="Get Scrapes" icon="list" href="api-reference/endpoint/get-scrapes">
  Use the /get\_scrapes endpoint to get metadata and signed URLs for your scrapes
</Card>

## Authentication

All API endpoints are authenticated using Bearer tokens and picked up from the specification file.

```json theme={null}
"security": [
  {
    "bearerAuth": []
  }
]
```