apidojo-io/apidojo-skills

scraping-twitter-profiles

Scrapes Twitter/X profile data for any list of usernames using apidojo's Twitter User scraper on Apify.

Zobacz źródło

Jak używać

  1. Skopiuj polecenie instalacji i sprawdź źródła przed instalacją we własnym środowisku agenta.
  2. W oryginale sprawdź wymagane narzędzia, dane dostępowe i obsługiwane środowiska.
  3. Opisz dane wejściowe i oczekiwany rezultat; porównaj wynik ze źródłami.
npx skills add https://github.com/apidojo-io/apidojo-skills --skill scraping-twitter-profiles

Przed rozpoczęciem

  • Instalacja nie obejmuje subskrypcji modelu, limitu API ani uprawnień do plików.
  • Gwiazdki i instalacje pokazują aktywność, a nie niezależny test jakości lub bezpieczeństwa.
Oryginalny dokument Skill

Treść z repozytorium z zachowaniem nagłówków, przykładów, kodu, tabel, linków i obrazów.

Scraping Twitter Profiles

Bulk profile data export for any set of Twitter/X usernames. Returns account-level metadata: follower counts, bios, join dates, verification status.

Prerequisites

  • APIFY_TOKEN environment variable set
  • Optional: Apify MCP server installed

Inputs

ParameterTypeRequiredDefaultNotes
startUrlsarrayOptional[]Twitter profile or tweet URLs
twitterHandlesarrayOptional[]Twitter usernames (without @)
twitterUserIdsarrayOptional[]Twitter user IDs
getFollowersbooleanOptionalfalseExtract follower lists
getFollowingbooleanOptionalfalseExtract following lists
getRetweetersbooleanOptionalfalseExtract retweeters of a tweet URL
includeUnavailableUsersbooleanOptionalfalseInclude unavailable/suspended users
maxItemsnumberOptionalUnlimitedMaximum users to return
customMapFunctionstringOptional—JavaScript function to transform each output object

Workflow

Progress:
- [ ] Step 1: Normalize username list
- [ ] Step 2: Run twitter-user-scraper
- [ ] Step 3: Poll for SUCCEEDED
- [ ] Step 4: Deliver profile dataset

Step 1: Normalize

Remove @ symbols, deduplicate, validate no empty strings.

Step 2: Run the Actor

Recommended — run_actor.js (handles waiting, output, and file saving automatically):

bash
# Quick answer (prints table to chat)
node scripts/run_actor.js \
  --actor "apidojo~twitter-user-scraper" \
  --input '{"param": "value"}'

# Save as CSV
node scripts/run_actor.js \
  --actor "apidojo~twitter-user-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.csv --format csv

# Save as JSON
node scripts/run_actor.js \
  --actor "apidojo~twitter-user-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.json --format json
APIFY_TOKEN must be set in environment or .env file.

If Apify MCP is available:

Tool: apify:run-actor
Actor: "apidojo~twitter-user-scraper"
Input:
{
  "usernames": ["handle1", "handle2", "handle3"]
}

REST API fallback:

bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~twitter-user-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"usernames": ["handle1", "handle2"]}'

Save id as RUN_ID. Poll until status = SUCCEEDED:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'

Fetch results:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"

Step 3: Handle Edge Cases

  • Missing accounts in results: Account suspended, deleted, or handle changed. Note missing handles in output.
  • Private accounts: Returns profile metadata but no tweet content — flag isPrivate: true rows.
  • Deactivated accounts: Returns null or empty object — exclude from final dataset.

Output Format

# Twitter Profile Dataset
Accounts requested: N | Accounts returned: N | Missing: N

| Username | Display Name | Followers | Following | Tweets | Verified | Bio (truncated) | Joined |
|----------|-------------|-----------|-----------|--------|----------|-----------------|--------|
| ...      | ...         | ...       | ...       | ...    | ...      | ...             | ...    |

Available fields: username, displayName, followersCount, followingCount, tweetCount,
isVerified, isBlueVerified, description, location, url, profileImageUrl, createdAt, isPrivate

Troubleshooting

Some handles missing from results: Accounts may be suspended or renamed — cross-reference manually. Large lists (> 1000): Break into batches of 500 and run sequentially.

Powiązane zadania

z tego samego repozytorium

Więcej Skills

Wszystkie Skills
apidojo-io
Społeczność

finding-digital-agencies-via-google-search

Finds digital marketing agencies, creative studios, and web design firms via Google Search using apidojo's Google Search Scraper on Apify. Triggers when the user asks to: find digital agencies for outreach or partnership, discover marketing agencies in a specific city, build a list of SEO agencies or web design studios via Google, find creative agencies that might need your software, prospect marketing firms by searching Google, identify agencies by specialty and location, or compile an agency c

Instalacje / 1h
3
GitHub Stars
1
Aktualizacja
13 maj
apidojo-io
Społeczność

discovering-viral-tiktok-content-trends

Discovers viral content trends and trending formats on TikTok using apidojo's TikTok scraper on Apify. Triggers when the user asks to: find trending content formats on TikTok, discover what is going viral on TikTok in a niche, identify viral TikTok hooks or video styles to adapt, research TikTok trends for a product category, find what content formats are performing best on TikTok right now, discover trending sounds or concepts in a niche on TikTok, or analyze what drives viral TikTok engagement

Instalacje / 1h
2
GitHub Stars
1
Aktualizacja
13 maj
apidojo-io
Społeczność

finding-podcast-hosts-for-outreach

Finds podcast hosts for PR and guest outreach using apidojo's Twitter scrapers on Apify. Triggers when the user asks to: find podcast hosts to pitch for a guest spot, discover podcasters in a niche for PR outreach, build a podcast outreach list from Twitter, find podcast hosts who cover a specific topic or industry, identify podcasters who interview guests in a business niche, find B2B podcast hosts for thought leadership placement, or compile a list of podcast hosts for a media relations campai

Instalacje / 1h
2
GitHub Stars
1
Aktualizacja
13 maj
apidojo-io
Społeczność

finding-saas-company-leads-twitter

Finds SaaS companies and software startup leads from Twitter/X using apidojo's Twitter scrapers on Apify. Triggers when the user asks to: find SaaS companies on Twitter for partnership or sales outreach, build a list of software startups by vertical, find B2B SaaS founders or decision-makers on X, identify early-stage software companies by their Twitter activity, discover SaaS products in a specific niche from Twitter, find software vendors posting about product launches or fundraising, or compi

Instalacje / 1h
2
GitHub Stars
1
Aktualizacja
13 maj