arize-ai
20 skills with substantive source documentation and an official publisher or observed installation demand. Read each skill’s original documentation through its card.
arize-aiarize-admin
Manages Arize users, organizations, spaces, projects, roles, role bindings, resource restrictions, and API keys via the ax CLI. Use for enterprise admin workflows: inviting and offboarding users, onboarding new teams, creating custom roles for SAML/SSO mappings, assigning roles to users, restricting project-level access, and managing service keys for multi-tenant architectures. Covers ax users, ax organizations, ax spaces, ax projects, ax roles, ax role-bindings, and ax api-keys.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-ai-provider-integration
Creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features. Supports any LLM provider (e.g. OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM, Fireworks AI, Together AI). Use when the user mentions AI integration, LLM provider credentials, create integration, list integrations, update credentials, delete integration, or connecting an LLM provider to Arize.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-annotation
Creates and manages annotation configs (categorical, continuous, freeform label schemas) and annotation queues (human review workflows) on Arize. Applies human annotations to project spans via the Python SDK. Use when the user mentions annotation config, annotation queue, label schema, human feedback, bulk annotate spans, updateannotations, labeling queue, annotate record, or human review.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-compliance-audit
INVOKE THIS SKILL when auditing an AI agent or LLM app for regulatory compliance. Covers EU AI Act, GPAI Code of Practice, GDPR, NIST AI RMF, Colorado AI Act, HIPAA, and ISO 42001. Scans the codebase for compliance gaps, cross-references Arize instrumentation for audit trail coverage, and produces an actionable remediation checklist tailored to the selected frameworks.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-evaluator
Handles LLM-as-judge and code evaluator workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, code evaluator, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-instrumentation
Adds Arize AX tracing to an LLM application for the first time. Detects the stack, routes to the single matching integration doc, wires auto-instrumentation after user confirmation, and verifies traces land. Use when the user wants to instrument their app, add tracing from scratch, set up LLM observability, integrate OpenTelemetry or openinference, or get started with Arize tracing.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-instrumentation-health
Audits instrumentation health of existing Arize traces. Runs deterministic checks over a bounded span sample (orphaned/uncategorized/duplicate spans, flat structure, blank root I/O, unset status, missing token counts or children) and returns a ranked report. Use when the user asks why traces look empty/flat/broken, wants to verify instrumentation is healthy, find instrumentation issues, or why evals or token/cost dashboards show n/a or zero. To debug app behavior or errors, use arize-trace.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-link
Generates deep links to the Arize UI for projects, traces, spans, sessions, datasets, experiments, labeling queues, evaluators, and annotation configs. Discovers organization and project IDs with the ax CLI and produces clickable URLs for sharing Arize resources with team members. Use when the user wants to link to or open a project, trace, span, session, dataset, experiment, evaluator, or annotation config in the Arize UI.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-migrate-braintrust
Migrates LLM observability from Braintrust into Arize AX — historical trace import via OTLP (BT output→output.value, spanparents, one AX trace per turn + session.id), datasets, and prompts (latest or versions). Use when migrating from Braintrust to Arize or importing Braintrust logs into AX.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-span-routing
Use when one Python service must send each agent's, tenant's, team's, or request's spans to its correct Arize space and project using application metadata. Covers dynamic OpenTelemetry routing for custom agent builders and multi-tenant applications, including registerwithrouting, setroutingcontext, multi-space tracing, and custom span routing.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiarize-trace
Downloads, exports, and inspects existing Arize traces and spans to understand what an LLM app is doing or debug runtime issues. Covers exporting traces by ID, spans by ID, sessions by ID, and root-cause investigation using the ax CLI. Use when the user wants to look at existing trace data, see what their LLM app is doing, export traces, download spans, investigate errors, or analyze behavior regressions.
- instalações
- 3
- GitHub Stars
- 58
- Atualizado
- 7 de out.
arize-aiphoenix-tracing
OpenInference semantic conventions and instrumentation for Phoenix AI observability. Use when implementing LLM tracing, creating custom spans, or deploying to production.
- instalações
- 2
- GitHub Stars
- 11,6 mil
- Atualizado
- 25 de set.
arize-aiarize-dataset
Creates, manages, and queries Arize datasets and examples. Covers dataset CRUD, appending examples, exporting data, and file-based dataset creation using the ax CLI. Use when the user needs test data, evaluation examples, or mentions create dataset, list datasets, export dataset, append examples, dataset version, golden dataset, or test set.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-experiment
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance. Covers experiment CRUD, exporting runs, comparing results, and evaluation workflows using the ax CLI. Use when the user mentions create experiment, run experiment, compare models, model performance, evaluate AI, experiment results, benchmark, A/B test models, or measure accuracy.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-migrate-langfuse
Migrates LLM observability from Langfuse into Arize AX — historical trace import via OTLP (LF output→output.value, sessionId→session.id), datasets, and prompts (latest or versions + labels). Use when migrating from Langfuse to Arize or importing Langfuse observations into AX.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-migrate-langsmith
Migrates LLM observability from LangSmith into Arize AX — historical trace import via OTLP (LS outputs→output.value, session/thread→session.id), datasets, and Prompt Hub prompts (latest or versions). Use when migrating from LangSmith to Arize, importing LangSmith runs into AX, or replacing LangSmith with Arize.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-phoenix-migration
Migrate existing Phoenix (PX) traces, datasets, experiments, and stored evaluation results into Arize AX and verify the imported records. Use when users ask to move or copy historical Phoenix data to AX; not for adding live instrumentation or exporting AX data alone.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-prompt-optimization
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output quality, prompt engineering, prompt tuning, or system prompt improvement.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiarize-prompts
INVOKE THIS SKILL for Arize Prompt Hub and ax prompts workflows: author or import templates and save (Workflows A–B), label/promote (C), or list/get/edit/delete/duplicate (D). Use when the user mentions ax prompts, Prompt Hub, creating/editing/saving a prompt, {variable} placeholders, or production/staging labels. For improving prompt text using traces or eval scores, use arize-prompt-optimization. For running experiments, use arize-experiment.
- instalações
- 1
- GitHub Stars
- 65
- Atualizado
- 20 de out.
arize-aiphoenix-harbor
Configure and interpret the Phoenix plugin for Harbor agent evaluations. Use when adding arize-phoenix to Harbor jobs, choosing ATIF tracing, mapping Harbor tasks and rewards to Phoenix experiments, comparing agents or models, resuming jobs, or troubleshooting Harbor records in Phoenix.
- instalações
- 1
- GitHub Stars
- 11,5 mil
- Atualizado
- 17 de set.