apidojo-io/apidojo-skills

scraping-twitter-list-members

Scrapes all members and their profile data from any public Twitter/X list using apidojo's Twitter List scraper on Apify.

Voir la source

Mode d’emploi

  1. Copiez la commande et examinez le paquet avant de l’installer dans votre environnement agent.
  2. Consultez le document original pour les outils, identifiants et environnements requis.
  3. Décrivez les entrées et le livrable souhaité ; comparez la sortie aux sources.
npx skills add https://github.com/apidojo-io/apidojo-skills --skill scraping-twitter-list-members

Avant de commencer

  • L’installation n’inclut ni abonnement au modèle, ni quota API, ni accès aux fichiers.
  • Étoiles et installations reflètent l’activité, pas un test indépendant de qualité ou de sécurité.
Document Skill original

Rendu depuis le dépôt source en conservant titres, exemples, code, tableaux, liens et images.

Scraping Twitter List Members

Exports all member profiles from any public Twitter/X list. Useful for curated industry lists, competitor watchlists, or pre-built audiences.

Prerequisites

  • APIFY_TOKEN environment variable set
  • Optional: Apify MCP server installed

Inputs

ParameterTypeRequiredDefaultNotes
startUrlsarrayOptional[]Twitter list URLs (e.g. https://x.com/i/lists/12345)
listIdsarrayOptional[]Twitter list IDs
maxItemsnumberOptionalUnlimitedMaximum tweets to return
customMapFunctionstringOptional—JavaScript function to transform each output object

Workflow

Progress:
- [ ] Step 1: Validate list URL
- [ ] Step 2: Run twitter-list-scraper
- [ ] Step 3: Poll for SUCCEEDED
- [ ] Step 4: Deliver member dataset

Step 2: Run the Actor

Recommended — run_actor.js (handles waiting, output, and file saving automatically):

bash
# Quick answer (prints table to chat)
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}'

# Save as CSV
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.csv --format csv

# Save as JSON
node scripts/run_actor.js \
  --actor "apidojo~twitter-list-scraper" \
  --input '{"param": "value"}' \
  --output YYYY-MM-DD_results.json --format json
APIFY_TOKEN must be set in environment or .env file.

If Apify MCP is available:

Tool: apify:run-actor
Actor: "apidojo~twitter-list-scraper"
Input:
{
  "listUrl": "https://twitter.com/i/lists/<LIST_ID>",
  "maxItems": 500
}

REST API fallback:

bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~twitter-list-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"listUrl": "https://twitter.com/i/lists/<LIST_ID>"}'

Save id as RUN_ID. Poll until status = SUCCEEDED:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'

Fetch results:

bash
curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"

Step 3: Handle Edge Cases

  • Private list: Actor returns 0 results — inform user the list is not publicly accessible.
  • List deleted or moved: Validate URL returns 200 before running actor.
  • Very large lists (> 5000 members): May timeout — use maxItems: 2000 and paginate.

Output Format

# Twitter List Members: <list name>
List URL: <url> | Members collected: N

| Username | Display Name | Followers | Bio (truncated) | Location | Verified |
|----------|-------------|-----------|-----------------|----------|----------|
| ...      | ...         | ...       | ...             | ...      | ...      |

Troubleshooting

0 results: List is private or URL is malformed. Verify the list is public. Partial results: Large lists may be rate-limited — retry with smaller maxItems.

Tâches connexes

du même dépôt

Autres Skills

Tous les Skills
apidojo-io
Communauté

finding-industry-event-coverage-google

Finds industry event and conference coverage on Google using apidojo's Google Search scraper. Triggers when the user asks to: find coverage of an industry conference or event on Google, track press coverage of a trade show or summit, research what was announced at a conference, find news and recaps of an industry event, discover what happened at a recent trade show, find speaker quotes or session summaries from a conference, or compile event coverage for competitive intelligence. Returns article

Installations / 1h
1
GitHub Stars
1
Mis à jour
13 mai
apidojo-io
Communauté

finding-tiktok-shop-trending-products

Finds trending products on TikTok Shop using apidojo's TikTok scraper on Apify. Triggers when the user asks to: find trending TikTok Shop products, discover what products are selling on TikTok Shop right now, identify viral TikTok Shop items in a category, find trending items with TikTok affiliate links, research TikTok Shop bestsellers, discover products going viral on TikTok for e-commerce, find hot items being promoted by TikTok creators, or build a trending product list from TikTok Shop data

Installations / 1h
1
GitHub Stars
1
Mis à jour
13 mai
apidojo-io
Communauté

finding-tiktok-ugc-creators-for-brands

Finds TikTok UGC creators for brand campaigns using apidojo's TikTok scrapers on Apify. Triggers when the user asks to: find TikTok creators for user-generated content, discover UGC creators in a product category on TikTok, find micro-creators who post organic product reviews on TikTok, identify TikTok creators for paid UGC campaigns, find authentic content creators in beauty food tech or fitness on TikTok, or build a UGC creator roster for a brand. Returns creator handle, follower count, avg vi

Installations / 1h
2
GitHub Stars
1
Mis à jour
13 mai
apidojo-io
Communauté

finding-twitter-spaces-hosts-by-topic

Finds Twitter Spaces hosts in a specific topic area using apidojo's Twitter scrapers. Triggers when the user asks to: find Twitter Spaces hosts in a niche, discover people who run Twitter Spaces about a topic, find Spaces hosts to collaborate with or get featured on, identify active Twitter Spaces communities in an industry, find hosts running regular business or tech Spaces on Twitter, build a Twitter Spaces outreach list for thought leadership, or discover Twitter audio show hosts in a profess

Installations / 1h
2
GitHub Stars
1
Mis à jour
13 mai