firecrawl/cli

firecrawl-map

Discover and list a site's URLs, with search filtering.

Voir la source
Document Skill original

Rendu depuis le dépôt source en conservant titres, exemples, code, tableaux, liens et images.

firecrawl map

Discover URLs on a site. Use --search to find a specific page within a large site.

Prerequisite: map requires authentication (no keyless free tier); without credentials the CLI prompts an interactive login.

Quick start

bash
# Find a specific page on a large site
firecrawl map "<url>" --search "authentication" -o .firecrawl/filtered.txt

# Get all URLs
firecrawl map "<url>" --limit 500 --json -o .firecrawl/urls.json

Run firecrawl map --help for the full option list (sitemap handling, subdomains, etc.).

Done when: the URL list is saved under .firecrawl/ and you have selected the URLs to scrape or crawl next.

Tips

  • Map + scrape is a common pattern: use map --search to find the right URL, then scrape it.
  • Example: map https://docs.example.com --search "auth" → found /docs/api/authenticationscrape that URL.

See also

du même dépôt

Autres Skills

Tous les Skills
firecrawl
Officiel

firecrawl

Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting pages, gathering sources, discovering site URLs, bulk extraction, downloading a site, change alerts, or pages needing clicks/login — web only; local files route to firecrawl-parse. For papers use firecrawl-research-index; for library, API, error, or bug questions use firecrawl-developer-index.

installations
101,6 k
GitHub Stars
637
Mis à jour
22 sept.
firecrawl
Officiel

firecrawl-search

Find web sources with query-relevant page excerpts and optional full-page content, and discover workflows, data APIs, and indexes. Use for web research or finding structured records, listings, transcripts, and datasets. Supports semantic tool discovery, domain matching, and progressive catalogue browsing.

installations
82,5 k
GitHub Stars
637
Mis à jour
22 sept.
firecrawl
Officiel

firecrawl-scrape

Read a known webpage or execute a discovered workflow or data-provider capability. Use for page content or structured results once the URL or tool is selected.

installations
82,2 k
GitHub Stars
637
Mis à jour
22 sept.
firecrawl
Officiel

firecrawl-agent

Autonomously navigate websites and extract structured data across pages. Use when the task requires navigation or no suitable ready-made workflow or data provider covers it.

installations
79,8 k
GitHub Stars
637
Mis à jour
22 sept.