Overview
Add Firecrawl to any ModuleX agent or workflow. AI-powered web scraping, crawling, and search against the Firecrawl v1 REST API (api.firecrawl.dev/v1). Covers single-URL scraping, URL discovery (map), web search, multi-page crawls with job-id + status polling, LLM-based structured extraction, and batch scraping.
Authentication
- API Key
- ModuleX Managed Key
Available Actions
scrape — Scrape content from a single URL with advanced options. Best for single page content extraction when you know exactly which page contains the information.
scrape — Scrape content from a single URL with advanced options. Best for single page content extraction when you know exactly which page contains the information.
Parameters
["markdown"])true)Response
map_website — Map a website to discover all indexed URLs. Best for discovering URLs before deciding what to scrape.
map_website — Map a website to discover all indexed URLs. Best for discovering URLs before deciding what to scrape.
Parameters
true)Response
search — Search the web and optionally extract content from search results. Supports operators: site:, inurl:, intitle:, and exact match with quotes.
search — Search the web and optionally extract content from search results. Supports operators: site:, inurl:, intitle:, and exact match with quotes.
crawl — Start a crawl job on a website. Returns a job ID — use check_crawl_status to monitor.
crawl — Start a crawl job on a website. Returns a job ID — use check_crawl_status to monitor.
Parameters
100)false)false)false)Response
check_crawl_status — Check the status of a crawl job and retrieve results once complete.
check_crawl_status — Check the status of a crawl job and retrieve results once complete.
extract — Extract structured information from web pages using LLM capabilities. Best for extracting specific structured data.
extract — Extract structured information from web pages using LLM capabilities. Best for extracting specific structured data.
Parameters
false)false)false)Response
Limits & Quotas
- HTTP timeouts: 120s for scrape/map/search/status; 180s for crawl/extract/batch (long-running jobs).
- Snake_case input parameters are converted to camelCase for the
upstream API (
only_main_content→onlyMainContent, etc.). - Response
datacarries the upstream JSON body unchanged so callers see the rich nested metadata Firecrawl returns. - Failures (non-2xx, timeouts, parse errors) surface as
success=False+error; empty/blank API keys short-circuit.