smartworldarafath/rea_skill

brightdata-mcp

Bright Data Model Context Protocol (MCP) server for industrial web scraping, CAPTCHA bypass, residential proxy routing, and search engine data extraction (brightdata/brightdata-mcp).

Voir la source

Mode d’emploi

  1. Copiez la commande et examinez le paquet avant de l’installer dans votre environnement agent.
  2. Consultez le document original pour les outils, identifiants et environnements requis.
  3. Décrivez les entrées et le livrable souhaité ; comparez la sortie aux sources.
npx skills add https://github.com/smartworldarafath/rea_skill --skill brightdata-mcp

Avant de commencer

  • L’installation n’inclut ni abonnement au modèle, ni quota API, ni accès aux fichiers.
  • Étoiles et installations reflètent l’activité, pas un test indépendant de qualité ou de sécurité.
Document Skill original

Rendu depuis le dépôt source en conservant titres, exemples, code, tableaux, liens et images.

Bright Data MCP (Anti-Bot Web Scraping & Data Extraction)

Based on brightdata/brightdata-mcp: an all-in-one Model Context Protocol (MCP) server providing AI agents with resilient, real-time public web access powered by Bright Data's Web Unlocker and proxy infrastructure.


🎯 When to Use

  • Anti-Bot & CAPTCHA Bypassing: When target sites block curl, standard fetch, or headless browsers with Cloudflare, DataDome, or Akamai anti-bot challenges.
  • SERP & Search Engine Scraping: Extracting Google, Bing, or DuckDuckGo search engine result pages (SERPs) with structured JSON output.
  • Large-Scale Public Web Extraction: Scraping product catalogs, reviews, public directory profiles, or news articles without rate-limiting IP bans.

🚀 Setup & Registration

MCP Configuration

Register Bright Data MCP in your agent's configuration (.mcp.json or IDE settings):

json
{
  "mcpServers": {
    "brightdata": {
      "command": "npx",
      "args": ["-y", "@brightdata/mcp"],
      "env": {
        "BRIGHTDATA_API_KEY": "YOUR_BRIGHTDATA_API_KEY"
      }
    }
  }
}

Note: Bright Data offers a free tier of 5,000 requests/month without credit card.


🛠️ Key Capabilities & Tools

  • scrape_url: Fetches clean HTML or Markdown content from any URL, automatically executing JavaScript and solving CAPTCHAs.
  • search_engine: Runs structured queries across Google and returns ranked organic, sponsored, and snippet items.
  • extract_structured_data: Converts target pages directly into validated JSON schemas.

⚡ Integration with REA & Security Audits

  • Auditing Blocked Endpoints: When an external target API or website endpoint returns 403 Forbidden due to IP reputation, route through Bright Data MCP to analyze real response headers and payloads.
  • Competitor & Pre-Release Research: Gather public security advisories and competitor feature implementations without triggering rate limits.
du même dépôt

Autres Skills

Tous les Skills
smartworldarafath
Communauté

agent-introspection-debugging

Structured self-debugging workflow for AI agent failures using capture, diagnosis, contained recovery, and introspection reports. Use when an agent run fails and you need a reproducible diagnosis instead of a retry.

Installations / 1h
2
GitHub Stars
5
Mis à jour
8 nov.
smartworldarafath
Communauté

agent-reach

Read-only access to internet platforms (Twitter/X, Reddit, YouTube subtitles, GitHub, LinkedIn, Bilibili, web). Use when the agent needs to search, read web links, retrieve social discussions, CVE/vulnerability intel, or when standard web search/fetch is blocked or insufficient.

Installations / 1h
2
GitHub Stars
5
Mis à jour
8 nov.
smartworldarafath
Communauté

agent-sort

Build an evidence-backed ECC install plan for a specific repo by sorting skills, commands, rules, hooks, and extras into DAILY vs LIBRARY buckets using parallel repo-aware review passes. Use when ECC should be trimmed to what a project actually needs instead of loading the full bundle.

Installations / 1h
2
GitHub Stars
5
Mis à jour
8 nov.
smartworldarafath
Communauté

anti-ai-slop-writing

Produces human-sounding text that avoids detectable AI writing patterns. Activates on any writing task — tweets, emails, articles, bios, captions, reports, copy, messages, LinkedIn posts, cover letters, README files, or any content where the output must not read as AI-generated. Enforces banned vocabulary, structural variety, punctuation discipline, accuracy rules, and voice calibration. Use when the user says "write," "draft," "rewrite," "make this sound human," "anti-slop," "not AI," or any va

Installations / 1h
2
GitHub Stars
5
Mis à jour
8 nov.