owasp/secure-agent-playbook

llm-risk-assess

Comprehensive LLM security assessment against OWASP Top 10 for LLM Applications 2025.

查看源码

使用方法

  1. 复制安装命令,在自己的智能体环境安装前先检查源码包。
  2. 从原始文档核对所需工具、凭据和支持的宿主。
  3. 说明输入材料与期望交付物,并对照来源检查输出。
npx skills add https://github.com/owasp/secure-agent-playbook --skill llm-risk-assess

开始前需了解

  • 安装不包含模型订阅、API 额度或访问文件的权限。
  • 仓库星数和安装量反映活跃情况,不等于独立质量或安全测试。
仓库原始内容

按源仓库内容呈现,保留标题、案例、代码、表格、链接以及原文引用的演示图片。

LLM Risk Assessment (2025)

Comprehensive evaluation of LLM applications against OWASP Top 10 for LLM Applications 2025. Follow the detailed procedure in plays/llm-risk-assess.md.

Steps

  1. Architecture & Threat Modeling
  • Map LLM provider (OpenAI, Anthropic, local models)
  • Document data flows: user input → preprocessing → prompt construction → LLM → output processing → actions
  • Identify RAG components, tool integrations, memory systems
  • Define trust boundaries and attack surfaces
  1. Automated Security Testing
  • Run prompt injection probes (Garak, Giskard, custom scripts)
  • Test output handling vulnerabilities
  • Scan for secrets in prompts and configurations
  • Validate vector database security
  1. Assess All 10 OWASP LLM 2025 Risks with attack scenarios:
  • LLM01 Prompt Injection — Direct/indirect injection, jailbreaks, goal hijacking, delimiter bypasses
  • LLM02 Sensitive Information Disclosure — Training data leakage, PII exposure, system info extraction, memorized secrets
  • LLM03 Supply Chain — Model poisoning, malicious dependencies, insecure plugins, provenance issues
  • LLM04 Data and Model Poisoning — Training data poisoning, RAG poisoning, embedding manipulation
  • LLM05 Improper Output Handling — XSS, command injection, SQLi, path traversal via LLM outputs
  • LLM06 Excessive Agency — Unauthorized tool calls, permission escalation, dangerous action chains
  • LLM07 System Prompt Leakage — Prompt extraction attacks, secret disclosure, instruction reverse engineering
  • LLM08 Vector and Embedding Weaknesses — Adversarial embeddings, retrieval poisoning, similarity attacks
  • LLM09 Misinformation — Hallucinations, authoritative presentation, grounding failures, harmful domains
  • LLM10 Unbounded Consumption — Token exhaustion, cost attacks, resource exhaustion, DoS
  1. Red Team Testing
  • Attempt real-world attack scenarios
  • Test defense bypasses and evasion techniques
  • Validate guardrails and safety controls

Output

Comprehensive LLM security report:

  • Architecture diagram with trust boundaries
  • Risk matrix (all 10 categories with severity/status)
  • Detailed findings with proof-of-concept examples
  • Red team test results and bypass techniques
  • Remediation roadmap with code examples
  • Defense validation checklist

OWASP References

  • OWASP Top 10 for LLM Applications 2025
  • OWASP AI Exchange (owaspai.org)
  • OWASP AI Testing Guide
  • OWASP Cheat Sheet: Prompt Injection Prevention
  • OWASP Prompt Injection Taxonomy (Arcanum)

按任务相关推荐

来自同一仓库

更多 Skills

全部 Skills
owasp
社区

web-security-review

Review web applications against the OWASP Top 10 for Web Applications (2021). Use when auditing web apps, reviewing server-side code, or assessing web frameworks for the classic OWASP Top 10 risks including injection, broken auth, and XSS.

1小时安装量
2
GitHub Stars
209
最近更新
10月15日
owasp
社区

api-security-review

Comprehensive API security review against OWASP API Security Top 10 (2023). Use when reviewing OpenAPI/Swagger specs, auditing REST/GraphQL/gRPC implementations, testing authentication mechanisms, or checking API gateway configurations. Covers BOLA/IDOR, broken auth, mass assignment, rate limiting, SSRF, and more with real-world attack scenarios.

1小时安装量
1
GitHub Stars
204
最近更新
10月15日
owasp
社区

prompt-injection-test

Test LLM-integrated applications against known prompt injection techniques, evasion methods, and attack intents using the Arcanum PI Taxonomy. Use when red-teaming AI apps, validating guardrails, or deepening LLM01 (Prompt Injection) assessments.

1小时安装量
1
GitHub Stars
204
最近更新
10月15日
owasp
社区

code-review-security

Security-focused code review mapped to OWASP Top 10 and ASVS. Use when reviewing pull requests, auditing files or modules for vulnerabilities, or performing pre-merge security gate checks. Covers injection, auth, authorization, cryptography, data exposure, misconfiguration, and deserialization.

1小时安装量
1
GitHub Stars
184
最近更新
9月25日