apidojo-io/apidojo-skills

scraping-twitter-list-members

Scrapes all members and their profile data from any public Twitter/X list using apidojo's Twitter List scraper on Apify.

Quelltext ansehen

Verwendung

  1. Installationsbefehl kopieren und das Quellpaket vor der Installation in der eigenen Agentenumgebung prüfen.
  2. Benötigte Werkzeuge, Zugangsdaten und Hosts im Original prüfen.
  3. Eingabe und gewünschtes Ergebnis beschreiben und die Ausgabe mit den Quellen abgleichen.
npx skills add https://github.com/apidojo-io/apidojo-skills --skill scraping-twitter-list-members

Vor dem Start

  • Die Installation umfasst weder Modellabo noch API-Kontingent oder Dateizugriffsrechte.
  • Sterne und Installationen zeigen Aktivität, keine unabhängige Qualitäts- oder Sicherheitsprüfung.
Originales Skill-Dokument

Aus dem Quell-Repository gerendert; Überschriften, Beispiele, Code, Tabellen, Links und Bilder bleiben erhalten.

Scraping Twitter List Members

Exports all member profiles from any public Twitter/X list. Useful for curated industry lists, competitor watchlists, or pre-built audiences.

Prerequisites

  • APIFY_TOKEN environment variable set
  • Optional: Apify MCP server installed

Inputs

ParameterTypeRequiredDefaultNotes
startUrlsarrayOptional[]Twitter list URLs (e.g. https://x.com/i/lists/12345)
listIdsarrayOptional[]Twitter list IDs
maxItemsnumberOptionalUnlimitedMaximum tweets to return
customMapFunctionstringOptional—JavaScript function to transform each output object

Workflow

Progress:
- [ ] Step 1: Validate list URL
- [ ] Step 2: Run twitter-list-scraper
- [ ] Step 3: Poll for SUCCEEDED
- [ ] Step 4: Deliver member dataset

Step 2: Run the Actor

Recommended — run_actor.js (handles waiting, output, and file saving automatically):

bash
# Quick answer (prints table to chat)
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}'

# Save as CSV
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.csv --format csv

# Save as JSON
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.json --format json
APIFY_TOKEN must be set in environment or .env file.

If Apify MCP is available:

Tool: apify:run-actor
Actor: "apidojo~twitter-list-scraper"
Input:
{
  "listUrl": "https://twitter.com/i/lists/<LIST_ID>",
  "maxItems": 500
}

REST API fallback:

bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~twitter-list-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"listUrl": "https://twitter.com/i/lists/<LIST_ID>"}'

Save id as RUN_ID. Poll until status = SUCCEEDED:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'

Fetch results:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"

Step 3: Handle Edge Cases

  • Private list: Actor returns 0 results — inform user the list is not publicly accessible.
  • List deleted or moved: Validate URL returns 200 before running actor.
  • Very large lists (> 5000 members): May timeout — use maxItems: 2000 and paginate.

Output Format

# Twitter List Members: <list name>
List URL: <url> | Members collected: N

| Username | Display Name | Followers | Bio (truncated) | Location | Verified |
|----------|-------------|-----------|-----------------|----------|----------|
| ...      | ...         | ...       | ...             | ...      | ...      |

Troubleshooting

0 results: List is private or URL is malformed. Verify the list is public. Partial results: Large lists may be rate-limited — retry with smaller maxItems.

Verwandte Aufgaben

aus demselben Repository

Weitere Skills

Alle Skills
apidojo-io
Community

finding-industry-event-coverage-google

Finds industry event and conference coverage on Google using apidojo's Google Search scraper. Triggers when the user asks to: find coverage of an industry conference or event on Google, track press coverage of a trade show or summit, research what was announced at a conference, find news and recaps of an industry event, discover what happened at a recent trade show, find speaker quotes or session summaries from a conference, or compile event coverage for competitive intelligence. Returns article

Installationen / 1h
1
GitHub Stars
1
Aktualisiert
13. Mai
apidojo-io
Community

finding-tiktok-shop-trending-products

Finds trending products on TikTok Shop using apidojo's TikTok scraper on Apify. Triggers when the user asks to: find trending TikTok Shop products, discover what products are selling on TikTok Shop right now, identify viral TikTok Shop items in a category, find trending items with TikTok affiliate links, research TikTok Shop bestsellers, discover products going viral on TikTok for e-commerce, find hot items being promoted by TikTok creators, or build a trending product list from TikTok Shop data

Installationen / 1h
1
GitHub Stars
1
Aktualisiert
13. Mai
apidojo-io
Community

finding-tiktok-ugc-creators-for-brands

Finds TikTok UGC creators for brand campaigns using apidojo's TikTok scrapers on Apify. Triggers when the user asks to: find TikTok creators for user-generated content, discover UGC creators in a product category on TikTok, find micro-creators who post organic product reviews on TikTok, identify TikTok creators for paid UGC campaigns, find authentic content creators in beauty food tech or fitness on TikTok, or build a UGC creator roster for a brand. Returns creator handle, follower count, avg vi

Installationen / 1h
2
GitHub Stars
1
Aktualisiert
13. Mai
apidojo-io
Community

finding-twitter-spaces-hosts-by-topic

Finds Twitter Spaces hosts in a specific topic area using apidojo's Twitter scrapers. Triggers when the user asks to: find Twitter Spaces hosts in a niche, discover people who run Twitter Spaces about a topic, find Spaces hosts to collaborate with or get featured on, identify active Twitter Spaces communities in an industry, find hosts running regular business or tech Spaces on Twitter, build a Twitter Spaces outreach list for thought leadership, or discover Twitter audio show hosts in a profess

Installationen / 1h
2
GitHub Stars
1
Aktualisiert
13. Mai