sergekostenchuk/ui-ux-agent-skill-system

server-log-crawler-analyst

Analyze credential-free public website monitoring evidence from server access logs, HTTP fetches, robots/llms/sitemap checks, and exported summaries while protecting raw IP and private query data.

Zobacz źródło

Jak używać

  1. Skopiuj polecenie instalacji i sprawdź źródła przed instalacją we własnym środowisku agenta.
  2. W oryginale sprawdź wymagane narzędzia, dane dostępowe i obsługiwane środowiska.
  3. Opisz dane wejściowe i oczekiwany rezultat; porównaj wynik ze źródłami.
npx skills add https://github.com/sergekostenchuk/ui-ux-agent-skill-system --skill server-log-crawler-analyst

Przed rozpoczęciem

  • Instalacja nie obejmuje subskrypcji modelu, limitu API ani uprawnień do plików.
  • Gwiazdki i instalacje pokazują aktywność, a nie niezależny test jakości lub bezpieczeństwa.
Oryginalny dokument Skill

Treść z repozytorium z zachowaniem nagłówków, przykładów, kodu, tabel, linków i obrazów.

Server Log Crawler Analyst

Use this skill when credential-free monitoring evidence is enough, or when credentialed Search Console, rank tracking, analytics, or assistant citation tools are unavailable.

Read references/data-source-tiers.md before producing a monitoring report.

Owns

  • credential-free monitoring baseline;
  • server access-log summary with IP privacy protection;
  • crawler/user-agent observation reports;
  • public HTTP checks for robots, llms.txt, sitemaps, RSS, and representative URLs;
  • data-source tiering;
  • monitoring limitations and unknowns;
  • backlog handoff for Search Console, rank/SERP, analytics, and LLM citation monitoring.

Does Not Own

  • credentialed Search Console or analytics API work;
  • scraping search engines;
  • bypassing bot protections;
  • live firewall or WAF changes;
  • claims about rankings or assistant citations without direct evidence;
  • storing raw IP logs in public artifacts.

Workflow

  1. Identify available evidence: public URL fetches, access-log snippet, exported summary, or synthetic fixture.
  2. Label the evidence tier and collection time.
  3. If logs are provided, summarize requests by path, status, user-agent class, and redacted IP hash.
  4. Separate known crawler hits from unknown bot-like traffic.
  5. Check public discovery endpoints when requested.
  6. Record limitations: no Search Console, no rank data, no assistant citation data unless explicitly provided.
  7. Produce a monitoring report using assets/crawler-monitor-report.template.md.
  8. Hand off credentialed or citation tasks to the backlog.

Non-Negotiables

  • Do not publish raw IP addresses.
  • Do not store credentials, cookies, API keys, or private analytics exports in skill files.
  • Do not infer ranking, indexing, or citation success from server logs alone.
  • Do not claim a user-agent is verified Google/OpenAI/Claude/Perplexity unless verification method is documented.
  • Do not scrape SERPs or assistants against terms of service.
  • Do not change firewall, WAF, robots, or server config from this skill.

Safety And Privacy Boundaries

  • Treat raw logs as private by default.
  • Use aggregated counts and redacted identifiers.
  • Keep exact timestamps only when needed for evidence; otherwise aggregate by hour/day.
  • If the user asks to publish a report, remove raw IP, query strings, session IDs, auth paths, and admin URLs unless explicitly needed and safe.
  • Public reports should say "observed in provided logs" rather than "definitely crawled by" unless bot verification is complete.

Evidence Labels

  • Observed: directly in log, HTTP response, or exported report.
  • Verified: observed and checked by an accepted verification method.
  • Inferred: likely based on user-agent/path/status, but not verified.
  • Open: no evidence available in this run.

Validation

Validate skill edits with:

bash
python3 $CODEX_HOME/skills/senior-skill-architect/scripts/lint_production_skill.py $HOME/SKILL/skills/server-log-crawler-analyst
python3 $HOME/SKILL/skills/server-log-crawler-analyst/scripts/analyze_access_log.py $HOME/SKILL/skills/server-log-crawler-analyst/fixtures/sample-access.log --report /tmp/server-log-crawler-report.json
python3 $HOME/SKILL/plans/seo-llm-skill-cluster/scripts/lint_skill_cluster.py $HOME/SKILL

Forward tests live in evals.json.

Output Shape

Return:

  1. Evidence source and timestamp.
  2. Data tier and privacy handling.
  3. Observed crawler/user-agent classes.
  4. Public endpoint status checks if performed.
  5. Suspicious or irrelevant bot traffic summary.
  6. Unknowns and claims refused.
  7. Monitoring backlog and next evidence needed.

Powiązane zadania

z tego samego repozytorium

Więcej Skills

Wszystkie Skills
sergekostenchuk
Społeczność

admin-ui-builder

Use when admin/CMS/back-office screens need to be built or specified after admin-ui-orchestrator defines roles, permissions, workflows, and safety gates. Covers tables, forms, editors, moderation queues, dashboards, CRUD surfaces, and state coverage without production destructive actions.

Instalacje / 1h
1
GitHub Stars
35
Aktualizacja
13 wrz
sergekostenchuk
Społeczność

admin-ui-orchestrator

Use when a project needs admin/CMS/back-office UI architecture: roles, permissions, content workflows, AI assistant boundaries, audit logs, destructive-action confirmations, and builder handoff. Planning only; do not perform production admin actions or expose secrets.

Instalacje / 1h
1
GitHub Stars
35
Aktualizacja
13 wrz
sergekostenchuk
Społeczność

analytics-setup-architect

Use when a website or web app needs privacy-aware analytics architecture: GA4, Yandex Metrica, self-hosted analytics, consent, UTM, event taxonomy, funnels, dashboards, and launch verification. Do not mutate real analytics accounts or store credentials without explicit approval.

Instalacje / 1h
1
GitHub Stars
35
Aktualizacja
13 wrz
sergekostenchuk
Społeczność

editorial-quality-gate

Review public site content for editorial quality, source support, prompt residue, duplicate blocks, translation drift, hidden filler, and human usefulness before SEO or LLM-friendly publication. Use this skill when the user asks to quality-gate news briefs, longform explainers, blog posts, topic pages, project pages, translated content, or generated article drafts without changing the live publishing pipeline.

Instalacje / 1h
1
GitHub Stars
35
Aktualizacja
13 wrz