Skip to content
Firecrawl Build: Scrape

Firecrawl Build: Scrape

by Firecrawl
v0.1.0
ISC
Repository Docs
markdown Development
firecrawlscrapingweb-dataapi-integrationmarkdown

Summary

Integrate Firecrawl's /scrape endpoint into product code — turn a known URL into markdown, HTML, links, metadata or screenshots, with sensible defaults baked in.

Features

  • Guides /scrape integration for single-page extraction
  • Recommends markdown and onlyMainContent as defaults
  • Escalation rules to /search and /interact when scrape is the wrong tool
  • Covers ingestion, enrichment, changelog and pricing extraction patterns
  • Supports hosted Firecrawl or a self-hosted deployment

Install This Skill

Add this skill to your favorite AI agent in a few steps.

Any AI agent

This skill is plain instructions — it works with any assistant that accepts custom instructions or system prompts.

  1. Copy the skill content with the button below.
  2. Paste it into your agent's instruction file or system prompt (for example AGENTS.md, .cursorrules, or a custom instructions field).
  3. Ask the agent to apply the skill whenever the task matches.

Skill Content

Markdown Content

Copy this content and use it with your preferred AI agent

---
name: firecrawl-build-scrape
description: Integrate Firecrawl `/scrape` into product code for single-page extraction. Use when an app already has a URL and needs markdown, HTML, links, screenshots, metadata, or structured page output. Prefer this skill over broader crawl patterns when the feature is page-level.
license: ISC
metadata:
  author: firecrawl
  version: "0.1.0"
  homepage: https://www.firecrawl.dev
  source: https://github.com/firecrawl/skills
inputs:
  - name: FIRECRAWL_API_KEY
    description: Firecrawl API key for hosted Firecrawl requests.
    required: true
  - name: FIRECRAWL_API_URL
    description: Optional base URL for self-hosted Firecrawl deployments.
    required: false
---

# Firecrawl Build Scrape

Use this when the application already has the URL and needs content from one page.

## Use This When

- the feature starts from a known URL
- you need page content for retrieval, summarization, enrichment, or monitoring
- you want the default extraction primitive before considering `/interact`

## Default Recommendations

- Return `markdown` unless the feature truly needs another format.
- Use `onlyMainContent` for article-like pages where nav and chrome add noise.
- Add waits or other rendering options only when the page needs them.

## Common Product Patterns

- knowledge ingestion from known URLs
- enrichment from a company, product, or docs page
- pricing, changelog, and documentation extraction
- page-level quality checks or monitoring

## Escalation Rules

- If you do not have the URL yet, start with [firecrawl-build-search](../firecrawl-build-search/SKILL.md).
- If content requires clicks, typing, or multi-step navigation, escalate to [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md).

## Implementation Notes

- Keep the integration narrow: one feature, one URL, one extraction contract.
- Treat `/scrape` as the default primitive for downstream LLM or indexing pipelines.
- Request richer formats only when the consumer needs them, such as links, screenshots, or branding data.

## Docs (Source of Truth)

Read the source-of-truth page for your project language before writing integration code:

- **Node / TypeScript**: [docs.firecrawl.dev/agent-source-of-truth/node](https://docs.firecrawl.dev/agent-source-of-truth/node)
- **Python**: [docs.firecrawl.dev/agent-source-of-truth/python](https://docs.firecrawl.dev/agent-source-of-truth/python)
- **Rust**: [docs.firecrawl.dev/agent-source-of-truth/rust](https://docs.firecrawl.dev/agent-source-of-truth/rust)
- **Java**: [docs.firecrawl.dev/agent-source-of-truth/java](https://docs.firecrawl.dev/agent-source-of-truth/java)
- **Elixir**: [docs.firecrawl.dev/agent-source-of-truth/elixir](https://docs.firecrawl.dev/agent-source-of-truth/elixir)
- **cURL / REST**: [docs.firecrawl.dev/agent-source-of-truth/curl](https://docs.firecrawl.dev/agent-source-of-truth/curl)

## See Also

- [firecrawl-build](../firecrawl-build/SKILL.md)
- [firecrawl-build-search](../firecrawl-build-search/SKILL.md)
- [firecrawl-build-interact](../firecrawl-build-interact/SKILL.md)

Usage Instructions

Learn how to use this skill with different AI agents.

Claude Desktop

Add the Firecrawl plugin marketplace, then ask the agent to build a feature that scrapes a page. The skill also bundles Firecrawl MCP configuration, so editors that read bundled MCP metadata can wire up the Firecrawl tools from the same install.

Example Usage

Add a Firecrawl-backed endpoint that takes a docs URL and stores its main content as markdown.

Description

Firecrawl's build skills are for the case where you are shipping a feature that calls Firecrawl, not for an agent browsing the web on its own behalf. This one covers /scrape: the page-level primitive you reach for when the application already has a URL and needs its content.

What the skill actually contributes is judgement about defaults, which is where most first integrations go wrong. Return markdown unless the feature genuinely needs another format. Turn on onlyMainContent for article-shaped pages so navigation and footer chrome do not pollute the extraction. Add rendering waits only when a page demonstrably needs them, rather than as a reflex that slows every request.

It also encodes escalation rules, so an agent picks the right endpoint instead of forcing /scrape to do everything: if you do not have the URL yet, start from firecrawl-build-search; if getting the content requires clicking, typing or multi-step navigation, move up to firecrawl-build-interact. That routing is the difference between a working integration and a scraper that silently returns an empty shell for every JavaScript-heavy page.

Common patterns it targets are knowledge ingestion from known URLs, company and product page enrichment, pricing and changelog extraction, and page-level monitoring. Requires a Firecrawl account and FIRECRAWL_API_KEY; FIRECRAWL_API_URL points it at a self-hosted deployment instead. ISC-licensed, published by Firecrawl.

Related Skills

Skill: Redis Search

by Redis, Inc.

New

Redis' own guidance for FT.CREATE schema design, FT.SEARCH / FT.AGGREGATE / FT.HYBRID, HNSW vector similarity and RAG retrieval pipelines.

Development

Skill: Supabase

by Supabase

New

Supabase's official skill covering Database, Auth, Edge Functions, Realtime, Storage, Vectors, Cron and Queues — with a hard rule to verify against the live changelog before writing code.

Development

Skill: GSAP ScrollTrigger

by GreenSock

New

GreenSock's official ScrollTrigger skill — scroll-linked animation, pinning, scrub and trigger positioning, with the exact start/end syntax agents get wrong.

DevelopmentDesign & Creative
1 views

Skill: Cloud Solution Architect

by Microsoft

New

Microsoft's official skill that turns an agent into an Azure solution architect — 10 design principles, 6 architecture styles, 44 design patterns and a Well-Architected review workflow.

Development
Browse all skills →