firecrawler
Web scraping and crawling with Firecrawl API.
Installation
npx clawhub@latest install firecrawlerView the full skill documentation and source below.
Documentation
Firecrawl Web Skill
Scrape, search, and crawl the web using [Firecrawl]().
Setup
export FIRECRAWL_API_KEY=fc-your-key-herepip3 install firecrawl
Usage
All commands use the bundled fc.py script in this skill's directory.
Get Page as Markdown
Fetch any URL and convert to clean markdown. Handles JavaScript-rendered content.
python3 fc.py markdown ""
python3 fc.py markdown "" --main-only # skip nav/footer
Take Screenshot
Capture a full-page screenshot of any URL.
python3 fc.py screenshot "" -o screenshot.png
Extract Structured Data
Pull specific fields from a page using a JSON schema.
Schema example (schema.json):
{
"type": "object",
"properties": {
"title": { "type": "string" },
"price": { "type": "number" },
"features": { "type": "array", "items": { "type": "string" } }
}
}
python3 fc.py extract "" --schema schema.json
python3 fc.py extract "" --schema schema.json --prompt "Extract the main product details"
Web Search
Search the web and get content from results (may require paid tier).
python3 fc.py search "Python 3.13 new features" --limit 5
Crawl Documentation
Crawl an entire documentation site. Great for learning new frameworks.
python3 fc.py crawl "" --limit 30
python3 fc.py crawl "" --limit 50 --output ./docs
Note: Each page costs 1 credit. Set reasonable limits.
Map Site URLs
Discover all URLs on a website before deciding what to scrape.
python3 fc.py map "" --limit 100
python3 fc.py map "" --search "api"
Example Prompts
- "Scrape and summarize it"
- "Take a screenshot of stripe.com"
- "Extract the name, price, and features from this product page"
- "Crawl the Astro docs so you can help me build a site"
- "Map all the URLs on docs.stripe.com"
Pricing
Free tier includes 500 credits. 1 credit = 1 page/screenshot/search query.