posthog/ai-plugin

triaging-error-issues

Triage PostHog error tracking issues during a daily or on-call review.

View source
Original skill document

Rendered from the source repository. Headings, examples, code, tables, links, and referenced images are preserved.

Triaging error tracking issues

When a user asks "what's broken?" or wants a daily error review, the goal is a short prioritized list of issues worth a human's attention — not a dump of every active issue. Most projects have hundreds of active issues; the few that matter are usually new (first seen in the last 24-48h), spiking, or affecting many distinct users.

Available tools

ToolPurpose
posthog:query-error-tracking-issues-listList + rank issues with aggregate metrics (occurrences, users, sessions)
posthog:query-error-tracking-issueCompact details for a single issue (status, assignee, top frame, release)
posthog:query-error-tracking-issue-eventsSampled $exception events with stack, URL, browser, and $session_id
posthog:query-session-recordings-listFind replays of users hitting an issue
posthog:inbox-reports-listPre-curated actionable signals if the project uses Inbox

Workflow

Step 1 — Pick a window and a signal

Read the time window from the user's wording. Defaults if unspecified:

  • "Today" / "this morning" / "right now" → dateRange: { date_from: "-24h" }
  • "This week" / "since Monday" → -7d
  • On-call shift handoff → -24h

Pick what "matters" means:

  • New issues — orderBy: "first_seen", orderDirection: "DESC", tight window.

Catches regressions introduced by recent deploys.

  • High-impact — orderBy: "users" ranks by distinct users affected. Better than

raw occurrences for severity (one bot loop produces many occurrences but one user).

  • Trending — orderBy: "occurrences" over a short window vs a longer baseline

to spot spikes.

Step 2 — Pull the candidate list

Start narrow and widen if too few issues come back:

json
posthog:query-error-tracking-issues-list
{
  "status": "active",
  "orderBy": "users",
  "orderDirection": "DESC",
  "dateRange": { "date_from": "-24h" },
  "limit": 20,
  "volumeResolution": 24
}

Match volumeResolution to the window (24 buckets for -24h, 14 for -14d, etc.) so each row's sparkline has enough resolution to show a spike vs flat steady state. A single bucket only gives a total, not a shape.

For new-issues-only, run a parallel query with orderBy: "first_seen":

json
{
  "status": "active",
  "orderBy": "first_seen",
  "orderDirection": "DESC",
  "dateRange": { "date_from": "-24h" },
  "limit": 10
}

If a project mixes browser and server SDKs, the top-by-users list is usually drowned by server-side errors (each invocation often gets a fresh distinct_id). Narrow with the library filter — values match the SDK's $lib, not the npm package name, examples:

  • web — posthog-js (browser)
  • posthog-node, posthog-python, posthog-ruby, posthog-go, posthog-php, posthog-java, posthog-elixir — server SDKs
  • posthog-edge — Cloudflare Workers / edge runtime
  • posthog-ios, posthog-android, posthog-react-native, posthog-flutter — mobile

Step 3 — Filter the noise

The list will include known noise. Before presenting, drop or call out:

  • Issues whose volume is flat over the window — they're not new, the user already

lives with them. Surface them only if they're in the top by users.

  • Bot-only issues — if all events come from headless browsers or crawler user agents,

flag for suppression (suppressing-noisy-errors) instead of triage.

If unsure whether an issue is new vs. recurring, compare first_seen to the start of the window:

  • first_seen inside the window → new, worth attention
  • first_seen weeks ago but spiking now → regression worth attention
  • first_seen weeks ago, flat volume → background noise

Step 4 — Add context for the top items

For the top 3-5 candidates, pull a sample exception so the summary includes a stack frame and URL, not just a title. Use posthog:query-error-tracking-issue-events rather than raw SQL — it returns normalized fields ($exception_types, $exception_values, $current_url, browser/OS, $session_id) and defaults to onlyAppFrames: true to strip vendor noise from the stack:

json
posthog:query-error-tracking-issue-events
{
  "issueId": "<issue_id>",
  "limit": 1,
  "include": ["exception", "stacktrace", "environment", "navigation", "correlation"]
}

If the user wants to see what users were doing, hand off to finding-replay-for-issue to pick the best linked recording. Don't fetch replays for every triaged issue — only the ones the user asks to dig into.

Step 5 — Present the triage list

Lead with a one-line headline ("3 new issues in last 24h, 1 spike, 5 active high-impact"). Then a short table sorted by your chosen signal:

IssueFirst seenUsersSessionsSample messageSuggested action
...2h ago142198TypeError ... at checkout.js:42Investigate
...spike6789Network request failedWatch — likely transient
...3d ago1212chrome-extension:// timeoutSuppress (extension noise)

For each, suggest one of: investigate (investigating-error-issue), assign (error-tracking-issues-partial-update), suppress (suppressing-noisy-errors), merge (grouping-noisy-errors), or resolve if it's already known fixed.

Tips

  • A single deploy often surfaces several related new issues. If multiple new issues

share a properties.$lib_version (or properties.$exception_releases when the SDK is configured to populate it), present them grouped — a rollback decision rests on the cluster, not any one issue.

  • "Users" is the right severity proxy for user-facing apps. For backend services

without a real distinct_id concept, fall back to sessions or occurrences.

  • Don't auto-assign or auto-resolve as part of triage. Present the list and let the

user decide. Bulk actions belong in dedicated skills.

  • If the project uses Inbox (posthog:inbox-reports-list), check it first — PostHog

may have already curated the most actionable issues so you avoid re-deriving them.

  • Provide each row's _posthogUrl (returned on every issue row) so the user can jump

straight to the issue page if they want to drill down themselves. If you build the link yourself, use the full /project/<project_id>/error_tracking/<id> path, never a bare /error_tracking/<id>.

Related skills

  • `investigating-error-issue` — deep-dive a single issue off the triage list
  • `grouping-noisy-errors` — when triage is drowned by duplicate or over-split issues
  • `suppressing-noisy-errors` — mute known-noise fingerprints so future triage runs are cleaner
  • `authoring-error-tracking-alerts` — route the issues worth acting on to Slack or a webhook instead of re-triaging manually
from this repository

More skills

All skills
posthog
Official

instrument-product-analytics

- Add PostHog product analytics events to track user behavior. Use after implementing new features or reviewing PRs to ensure meaningful user actions are captured. Also handles initial PostHog SDK setup if not yet installed.

installs
1
GitHub stars
81
Updated
Sep 10
posthog
Official

auditing-endpoints

Audit every endpoint in a PostHog project for staleness, failed materialisations, and unused materialised versions. Use when the user asks "what endpoints can I clean up?", "are any of my endpoints broken?", "which materialised versions are still being called?", or wants a one-shot cleanup pass over the Endpoints product. Produces a prioritised report grouped by issue type, with recommended actions but does not modify anything without explicit confirmation.

installs
1
GitHub stars
81
Updated
Sep 10
posthog
Official

authoring-data-quality-checks

Adds and runs data quality checks (dbt-test style assertions) on a project's warehouse tables and saved-query views: not-null, uniqueness, accepted values, referential integrity, row-count bounds, freshness, and custom HogQL. Use when asked to test a model, validate a view, check for nulls or duplicates, add data quality checks, find out why a number looks wrong, or judge whether a warehouse table is trustworthy before using it in an analysis. To describe what data means (metrics, certifications

installs
1
GitHub stars
81
Updated
Sep 10
posthog
Official

authoring-log-alerts

Author useful, low-noise log alerts on services in a PostHog project. Use when the user asks to set up alerts for their logs, suggest alerts they should add, or evaluate whether a service is worth monitoring. Covers service triage, baseline characterisation, threshold drafting, back-testing via simulate, and shipping with a notification destination.

installs
1
GitHub stars
81
Updated
Sep 10