Skip to main content
Firecrawl logo

Overview

Add Firecrawl to any ModuleX agent or workflow. AI-powered web scraping, crawling, and search against the Firecrawl v1 REST API (api.firecrawl.dev/v1). Covers single-URL scraping, URL discovery (map), web search, multi-page crawls with job-id + status polling, LLM-based structured extraction, and batch scraping.
Categories: Web Search & Scraping · Data · Search · Auth: API Key, ModuleX Managed Key · Actions: 7

Authentication

API Key Authentication

Authenticate using your Firecrawl API key

Required Credentials

Available Actions

Parameters

string
required
The URL to scrape
array
Content formats: markdown, html, rawHtml, screenshot, links, summary (Default: ["markdown"])
boolean
Extract only the main content, filtering out navigation/footers (Default: true)
array
HTML tags to specifically include in extraction
array
HTML tags to exclude from extraction
integer
Time in milliseconds to wait for dynamic content
boolean
Use mobile viewport
boolean
Remove base64-encoded images from output
integer
Maximum age in milliseconds for cached content. Enables faster scrapes for cached pages.

Response

Parameters

string
required
Starting URL for URL discovery
Optional search term to filter URLs
string
Sitemap handling: ‘include’, ‘skip’, or ‘only’
boolean
Include URLs from subdomains in results
integer
Maximum number of URLs to return
boolean
Do not return URLs with query parameters (Default: true)

Response

Parameters

string
required
Search query string (supports operators)
integer
Maximum number of results to return (Default: 5)
string
Time-based search filter
string
Location parameter for search results
object
Options for scraping search results

Response

Parameters

string
required
Starting URL for the crawl
array
URL paths to exclude from crawling
array
Only crawl these URL paths
integer
Maximum depth to crawl relative to the entered URL
integer
Maximum number of pages to crawl (Default: 100)
Allow crawling links to external domains (Default: false)
Allow crawling links to parent paths (Default: false)
boolean
Ignore the website sitemap when crawling (Default: false)
object
Options for scraping each page

Response

Parameters

string
required
Crawl job ID returned from the crawl action

Response

Parameters

array
required
Array of URLs to extract information from
string
Custom prompt for the LLM extraction
object
JSON schema for structured data extraction
Allow extraction from external links (Default: false)
Enable web search for additional context (Default: false)
boolean
Include subdomains in extraction (Default: false)

Response

Parameters

array
required
Array of URLs to scrape
array
Content formats to extract (Default: ["markdown"])
boolean
Extract only the main content (Default: true)

Response

Limits & Quotas

  • HTTP timeouts: 120s for scrape/map/search/status; 180s for crawl/extract/batch (long-running jobs).
  • Snake_case input parameters are converted to camelCase for the upstream API (only_main_contentonlyMainContent, etc.).
  • Response data carries the upstream JSON body unchanged so callers see the rich nested metadata Firecrawl returns.
  • Failures (non-2xx, timeouts, parse errors) surface as success=False + error; empty/blank API keys short-circuit.

Exa Search

Linkup

Serper