smartworldarafath/rea_skill

brightdata-mcp

Bright Data Model Context Protocol (MCP) server for industrial web scraping, CAPTCHA bypass, residential proxy routing, and search engine data extraction (brightdata/brightdata-mcp).

ソースを見る

使い方

  1. インストールコマンドをコピーし、自分の環境へ導入する前にソースを確認します。
  2. 必要なツール、認証情報、対応環境を原文で確認します。
  3. 入力と成果物を指定し、出力を資料と照合します。
npx skills add https://github.com/smartworldarafath/rea_skill --skill brightdata-mcp

開始前の確認

  • 導入にはモデル契約、API枠、ファイルへのアクセス許可は含まれません。
  • スター数や導入数は活動の指標であり、独立した品質・安全性試験ではありません。
リポジトリの原文

見出し、例、コード、表、リンク、参照画像を含む原文を表示しています。

Bright Data MCP (Anti-Bot Web Scraping & Data Extraction)

Based on brightdata/brightdata-mcp: an all-in-one Model Context Protocol (MCP) server providing AI agents with resilient, real-time public web access powered by Bright Data's Web Unlocker and proxy infrastructure.


🎯 When to Use

  • Anti-Bot & CAPTCHA Bypassing: When target sites block curl, standard fetch, or headless browsers with Cloudflare, DataDome, or Akamai anti-bot challenges.
  • SERP & Search Engine Scraping: Extracting Google, Bing, or DuckDuckGo search engine result pages (SERPs) with structured JSON output.
  • Large-Scale Public Web Extraction: Scraping product catalogs, reviews, public directory profiles, or news articles without rate-limiting IP bans.

🚀 Setup & Registration

MCP Configuration

Register Bright Data MCP in your agent's configuration (.mcp.json or IDE settings):

json
{
  "mcpServers": {
    "brightdata": {
      "command": "npx",
      "args": ["-y", "@brightdata/mcp"],
      "env": {
        "BRIGHTDATA_API_KEY": "YOUR_BRIGHTDATA_API_KEY"
      }
    }
  }
}

Note: Bright Data offers a free tier of 5,000 requests/month without credit card.


🛠️ Key Capabilities & Tools

  • scrape_url: Fetches clean HTML or Markdown content from any URL, automatically executing JavaScript and solving CAPTCHAs.
  • search_engine: Runs structured queries across Google and returns ranked organic, sponsored, and snippet items.
  • extract_structured_data: Converts target pages directly into validated JSON schemas.

⚡ Integration with REA & Security Audits

  • Auditing Blocked Endpoints: When an external target API or website endpoint returns 403 Forbidden due to IP reputation, route through Bright Data MCP to analyze real response headers and payloads.
  • Competitor & Pre-Release Research: Gather public security advisories and competitor feature implementations without triggering rate limits.
同じリポジトリから

関連する Skills

すべての Skills
smartworldarafath
コミュニティ

agent-introspection-debugging

Structured self-debugging workflow for AI agent failures using capture, diagnosis, contained recovery, and introspection reports. Use when an agent run fails and you need a reproducible diagnosis instead of a retry.

1時間の導入数
2
GitHub Stars
5
更新日
11月8日
smartworldarafath
コミュニティ

agent-reach

Read-only access to internet platforms (Twitter/X, Reddit, YouTube subtitles, GitHub, LinkedIn, Bilibili, web). Use when the agent needs to search, read web links, retrieve social discussions, CVE/vulnerability intel, or when standard web search/fetch is blocked or insufficient.

1時間の導入数
2
GitHub Stars
5
更新日
11月8日
smartworldarafath
コミュニティ

agent-sort

Build an evidence-backed ECC install plan for a specific repo by sorting skills, commands, rules, hooks, and extras into DAILY vs LIBRARY buckets using parallel repo-aware review passes. Use when ECC should be trimmed to what a project actually needs instead of loading the full bundle.

1時間の導入数
2
GitHub Stars
5
更新日
11月8日
smartworldarafath
コミュニティ

anti-ai-slop-writing

Produces human-sounding text that avoids detectable AI writing patterns. Activates on any writing task — tweets, emails, articles, bios, captions, reports, copy, messages, LinkedIn posts, cover letters, README files, or any content where the output must not read as AI-generated. Enforces banned vocabulary, structural variety, punctuation discipline, accuracy rules, and voice calibration. Use when the user says "write," "draft," "rewrite," "make this sound human," "anti-slop," "not AI," or any va

1時間の導入数
2
GitHub Stars
5
更新日
11月8日