smartworldarafath/rea_skill

brightdata-mcp

Bright Data Model Context Protocol (MCP) server for industrial web scraping, CAPTCHA bypass, residential proxy routing, and search engine data extraction (brightdata/brightdata-mcp).

查看源码

使用方法

  1. 复制安装命令,在自己的智能体环境安装前先检查源码包。
  2. 从原始文档核对所需工具、凭据和支持的宿主。
  3. 说明输入材料与期望交付物,并对照来源检查输出。
npx skills add https://github.com/smartworldarafath/rea_skill --skill brightdata-mcp

开始前需了解

  • 安装不包含模型订阅、API 额度或访问文件的权限。
  • 仓库星数和安装量反映活跃情况,不等于独立质量或安全测试。
仓库原始内容

按源仓库内容呈现,保留标题、案例、代码、表格、链接以及原文引用的演示图片。

Bright Data MCP (Anti-Bot Web Scraping & Data Extraction)

Based on brightdata/brightdata-mcp: an all-in-one Model Context Protocol (MCP) server providing AI agents with resilient, real-time public web access powered by Bright Data's Web Unlocker and proxy infrastructure.


🎯 When to Use

  • Anti-Bot & CAPTCHA Bypassing: When target sites block curl, standard fetch, or headless browsers with Cloudflare, DataDome, or Akamai anti-bot challenges.
  • SERP & Search Engine Scraping: Extracting Google, Bing, or DuckDuckGo search engine result pages (SERPs) with structured JSON output.
  • Large-Scale Public Web Extraction: Scraping product catalogs, reviews, public directory profiles, or news articles without rate-limiting IP bans.

🚀 Setup & Registration

MCP Configuration

Register Bright Data MCP in your agent's configuration (.mcp.json or IDE settings):

json
{
  "mcpServers": {
    "brightdata": {
      "command": "npx",
      "args": ["-y", "@brightdata/mcp"],
      "env": {
        "BRIGHTDATA_API_KEY": "YOUR_BRIGHTDATA_API_KEY"
      }
    }
  }
}

Note: Bright Data offers a free tier of 5,000 requests/month without credit card.


🛠️ Key Capabilities & Tools

  • scrape_url: Fetches clean HTML or Markdown content from any URL, automatically executing JavaScript and solving CAPTCHAs.
  • search_engine: Runs structured queries across Google and returns ranked organic, sponsored, and snippet items.
  • extract_structured_data: Converts target pages directly into validated JSON schemas.

⚡ Integration with REA & Security Audits

  • Auditing Blocked Endpoints: When an external target API or website endpoint returns 403 Forbidden due to IP reputation, route through Bright Data MCP to analyze real response headers and payloads.
  • Competitor & Pre-Release Research: Gather public security advisories and competitor feature implementations without triggering rate limits.
来自同一仓库

更多 Skills

全部 Skills
smartworldarafath
社区

agent-introspection-debugging

Structured self-debugging workflow for AI agent failures using capture, diagnosis, contained recovery, and introspection reports. Use when an agent run fails and you need a reproducible diagnosis instead of a retry.

1小时安装量
2
GitHub Stars
5
最近更新
11月8日
smartworldarafath
社区

agent-reach

Read-only access to internet platforms (Twitter/X, Reddit, YouTube subtitles, GitHub, LinkedIn, Bilibili, web). Use when the agent needs to search, read web links, retrieve social discussions, CVE/vulnerability intel, or when standard web search/fetch is blocked or insufficient.

1小时安装量
2
GitHub Stars
5
最近更新
11月8日
smartworldarafath
社区

agent-sort

Build an evidence-backed ECC install plan for a specific repo by sorting skills, commands, rules, hooks, and extras into DAILY vs LIBRARY buckets using parallel repo-aware review passes. Use when ECC should be trimmed to what a project actually needs instead of loading the full bundle.

1小时安装量
2
GitHub Stars
5
最近更新
11月8日
smartworldarafath
社区

anti-ai-slop-writing

Produces human-sounding text that avoids detectable AI writing patterns. Activates on any writing task — tweets, emails, articles, bios, captions, reports, copy, messages, LinkedIn posts, cover letters, README files, or any content where the output must not read as AI-generated. Enforces banned vocabulary, structural variety, punctuation discipline, accuracy rules, and voice calibration. Use when the user says "write," "draft," "rewrite," "make this sound human," "anti-slop," "not AI," or any va

1小时安装量
2
GitHub Stars
5
最近更新
11月8日