aizech/clinical-skills

model-validation

Designs and executes validation studies for radiology AI models to ensure clinical reliability and regulatory compliance.

소스 보기

사용 방법

  1. 설치 명령을 복사하고 자신의 에이전트 환경에 설치하기 전에 소스 패키지를 확인하세요.
  2. 필요한 도구, 인증 정보, 지원 환경은 원본 문서에서 확인하세요.
  3. 입력과 원하는 산출물을 설명하고 출처와 결과를 대조하세요.
npx skills add https://github.com/aizech/clinical-skills --skill model-validation

시작 전 확인

  • 설치에는 모델 구독, API 한도, 파일 접근 권한이 포함되지 않습니다.
  • 별점 수와 설치 수는 활동 지표이며 독립적인 품질·보안 검증이 아닙니다.
원본 Skill 문서

원본 저장소의 제목, 예시, 코드, 표, 링크, 이미지를 유지해 표시합니다.

Model Validation Skill

Triggers

  • "validate model performance"
  • "external validation"
  • "statistical analysis"
  • "clinical validation"
  • "model comparison"
  • "regulatory submission"
  • "performance benchmarking"
  • "fairness audit"

Parameters

  • validation_type (required): Type of validation needed
  • internal - Retrospective internal dataset
  • external - Prospective/out-of-distribution testing
  • prospective - Clinical deployment study
  • regulatory - FDA/EMA submission prep
  • fairness - Subgroup disparity analysis
  • comparison - Head-to-head model comparison
  • model_task (required): Model's intended use
  • detection - Sensitivity, specificity, PPV, NPV
  • segmentation - Dice, IoU, Hausdorff distance
  • classification - Accuracy, AUC, F1 score
  • regression - MAE, RMSE, correlation
  • modality (optional): Imaging modality
  • regulatory_path (optional): Target clearance pathway

Validation Framework

Performance Metrics

TaskPrimary MetricsSecondary
DetectionSensitivity, Specificity, AUCPPV, NPV, FROC
SegmentationDice, IoUHausdorff, ASD
ClassificationAccuracy, AUC, F1Sensitivity, Specificity
RegressionMAE, RMSECorrelation, Bland-Altman

Statistical Methods

  • Confidence intervals (bootstrap, binominal)
  • Significance testing (McNemar, DeLong for AUC)
  • Power analysis for sample sizing
  • Multiple comparison correction
  • Subgroup interaction testing

Regulatory Standards

  • FDA 510(k) predicate comparison
  • FDA De Novo requirements
  • EU MDR clinical evaluation
  • IMDRF clinical evidence framework
  • ACR-SIIM AI performance standards

Output Format

Returns structured JSON with:

  • Validation protocol and methodology
  • Required sample size with power analysis
  • Statistical test selection and rationale
  • Results template with standard metrics
  • Interpretation guidelines
  • Regulatory compliance checklist

Usage Examples

validation_type: external
model_task: detection
modality: CT

validation_type: regulatory
model_task: classification
regulatory_path: 510k
같은 저장소의 Skills

더 많은 Skills

모든 Skills