hamelsmu · Agent Skills
출처를 확인한 실질적인 문서가 있는 Skill 3개입니다. 카드를 열어 원문, 패키지 구성과 설치 방법을 확인하세요.
evaluate-rag
Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality, assessing generation faithfulness or relevance, generating synthetic QA pairs for retrieval testing, or optimizing chunking strategies.
- 1시간 설치 수
- 1
- GitHub Stars
- 1.7천
- 업데이트
- 8월 16일
validate-evaluator
Calibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you need to verify alignment before trusting its outputs. Do NOT use for code-based evaluators (those are deterministic; test with standard unit tests).
- 1시간 설치 수
- 1
- GitHub Stars
- 1.7천
- 업데이트
- 8월 16일
write-judge-prompt
Design LLM-as-Judge evaluators for subjective criteria that code-based checks cannot handle. Use when a failure mode requires interpretation (tone, faithfulness, relevance, completeness). Do NOT use when the failure mode can be checked with code (regex, schema validation, execution tests). Do NOT use when you need to validate or calibrate the judge — use validate-evaluator instead.
- 1시간 설치 수
- 1
- GitHub Stars
- 1.7천
- 업데이트
- 8월 16일
