posthog/ai-plugin

exploring-mcp-tool-usage

Starting point for exploring how a PostHog MCP server's tools are used — routes a broad question to the typed tool that answers it.

ソースを見る

使い方

  1. インストールコマンドをコピーし、自分の環境へ導入する前にソースを確認します。
  2. 必要なツール、認証情報、対応環境を原文で確認します。
  3. 入力と成果物を指定し、出力を資料と照合します。
npx skills add https://github.com/posthog/ai-plugin --skill exploring-mcp-tool-usage

開始前の確認

  • 導入にはモデル契約、API枠、ファイルへのアクセス許可は含まれません。
  • スター数や導入数は活動の指標であり、独立した品質・安全性試験ではありません。
リポジトリの原文

見出し、例、コード、表、リンク、参照画像を含む原文を表示しています。

Exploring MCP tool usage

Any MCP server instrumented with the @posthog/mcp SDK emits a $mcp_tool_call event every time an agent invokes a tool. This skill is the front door for a user who knows they want to look at their MCP tool usage but hasn't picked a specific question. Offer the menu below, then route to the tool — or the focused skill — that answers what they choose.

Every per-tool tool here is gated behind the mcp-analytics flag, takes a toolName (the effective tool name — resolved server-side, so pass the name the agent actually invokes — except `posthog:query-mcp-tool-failures`, which matches $exception events and so takes the raw registered $mcp_tool_name) plus a dateRange, and runs the same query runner the tool-detail UI uses. So results match the UI, and you never hand-write the HogQL.

Suggested questions

Lead with these when the user is unsure what to ask:

Ask the user…Answered by
"Which tools fail most, or are slowest?"exploring-mcp-tool-quality (ranks all tools), then posthog:query-mcp-tool-stats to drill in
"How is tool X doing overall?"posthog:query-mcp-tool-stats — calls, errors, p50/p95, users, sessions, intents
"How has tool X trended?"posthog:query-mcp-tool-daily-stats — day-by-day series
"Why is tool X failing?"posthog:query-mcp-tool-failures — top error messages, by harness (raw tool name)
"Who uses tool X the most?"posthog:query-mcp-tool-top-users — top callers (incl. person email/name)
"What gets called right before/after tool X?"posthog:query-mcp-tool-neighbors (neighborDirection: before/after)
"What are agents trying to do with tool X?"posthog:query-mcp-tool-sample-intents — recent agent intents
"What description is tool X registered with?"posthog:query-mcp-tool-descriptions — distinct descriptions seen
"Which harnesses use my MCP, how reliably?"posthog:query-mcp-harness-breakdown — calls/errors/sessions per client
"What are agents trying to do, across all tools?"exploring-mcp-intent-clusters — semantic goal clusters
"Who is connecting, and how active are they?"posthog:mcp-analytics-sessions-list — one row per session, with client and person
"What did this one session do?"exploring-mcp-sessions — a single agent run's tool sequence

Finding the tool name

The per-tool tools need a toolName. If the user named a tool, pass it. If they asked a broad "which tool…" question, start with exploring-mcp-tool-quality to rank the tools, pick the one that stands out, then drill in with the per-tool tools above. The name to pass is the effective tool name (the inner tool for single-exec wrapper calls) — the same string the tool-quality ranking returns. The one exception is posthog:query-mcp-tool-failures, which matches $exception events by the raw registered $mcp_tool_name, not the effective inner tool.

How to use a per-tool tool

Call it with the tool name and a window, e.g. for the headline numbers of a tool:

text
posthog:query-mcp-tool-stats  { "toolName": "<tool>", "dateRange": { "date_from": "-7d" } }

Then offer a natural follow-up from the menu — e.g. after posthog:query-mcp-tool-stats shows a high error rate, reach for posthog:query-mcp-tool-failures; after it shows broad reach, reach for posthog:query-mcp-tool-top-users or posthog:query-mcp-tool-neighbors.

When to drop to SQL

Covered by a typed tool — don't hand-write SQL for these:

QuestionTool
One tool's headline numbersposthog:query-mcp-tool-stats
One tool's day-by-day trendposthog:query-mcp-tool-daily-stats
One tool's top errorsposthog:query-mcp-tool-failures
One tool's top callersposthog:query-mcp-tool-top-users
Tools called before/after one toolposthog:query-mcp-tool-neighbors
One tool's recent agent intentsposthog:query-mcp-tool-sample-intents
One tool's registered descriptionsposthog:query-mcp-tool-descriptions
Usage split by client harnessposthog:query-mcp-harness-breakdown
List sessionsposthog:mcp-analytics-sessions-list
One session's tool callsposthog:mcp-analytics-sessions-tool-calls

Not covered — use `posthog:execute-sql`:

  • Cross-tool rankings (the tool-quality matrix — "which tool errors most?")
  • Errored-session filtering (the session list has no error filter or error count)
  • Effective tool names inside a session (posthog:mcp-analytics-sessions-tool-calls

returns the raw $mcp_tool_name, not the inner tool of a wrapper call)

  • Any custom breakdown

posthog:execute-sql is also the fallback when the mcp-analytics flag is off — every tool in the table above is gated behind it, execute-sql is not. Query $mcp_tool_call directly; the schema and recipes are in `models-mcp.md`.

Related skills

tools by error rate / latency / reach, then drill in

run and its tool sequence

agent goals grouped by semantic similarity

タスクに関連する項目

同じリポジトリから

関連する Skills

すべての Skills
posthog
公式

composing-grid-canvases

Compose PostHog grid canvases — widget grids (including the user's home canvas) built from reusable component canvases. Use when a task asks to add, fill, move, resize, or remove a widget on a grid or home canvas, to compose a whole canvas of widgets from one ask, to build a reusable widget/component, or when a placement id or grid canvas id is the target. Covers the component store search → configure → fork → build ladder, the component placement contract (size, configSchema), the placement lif

1時間の導入数
1
GitHub Stars
96
更新日
10月31日
posthog
公式

consuming-endpoints-from-client-code

Wire a PostHog endpoint into a client app or SDK. Covers fetching the OpenAPI spec, generating a typed client with openapi-generator or @hey-api/openapi-ts, sending the right auth header, shaping the variables payload (HogQL codename vs insight breakdown property), handling rate-limit and materialised-endpoint error responses. Use when the user says "how do I call my endpoint", "generate a client for this", or "what auth header do I use".

1時間の導入数
1
GitHub Stars
96
更新日
10月31日
posthog
公式

designing-email-templates

Author, save, and edit email templates in the PostHog workflows library — compose email design JSON with Liquid personalization and create and round-trip-edit templates over MCP. Use when asked to design, build, update, or fix an email template for workflows, broadcasts, or campaigns.

1時間の導入数
1
GitHub Stars
96
更新日
10月31日
posthog
公式

exploring-llm-evaluations

Investigate AI observability evaluations — hog (deterministic code-based), llmjudge (LLM-prompt-based), and sentiment (user-message sentiment). Find existing evaluations, inspect their configuration, run them against specific generations, query individual results, and set up scheduled reports on an evaluation. Use when the user asks to debug why an evaluation is failing, surface common failure modes, compare results across filters, dry-run a Hog evaluator, prototype a new LLM-judge prompt, inspe

1時間の導入数
1
GitHub Stars
96
更新日
10月31日