yogsoth-ai/de-anthropocentric-research-engine

audit-validator-independence

Audit whether a validator, benchmark, sandbox, or test can pass by construction because it embeds the same assumptions as the theory it claims to validate.

查看源码

使用方法

  1. 复制安装命令,在自己的智能体环境安装前先检查源码包。
  2. 从原始文档核对所需工具、凭据和支持的宿主。
  3. 说明输入材料与期望交付物,并对照来源检查输出。
npx skills add https://github.com/yogsoth-ai/de-anthropocentric-research-engine --skill audit-validator-independence

开始前需了解

  • 安装不包含模型订阅、API 额度或访问文件的权限。
  • 仓库星数和安装量反映活跃情况,不等于独立质量或安全测试。
仓库原始内容

按源仓库内容呈现,保留标题、案例、代码、表格、链接以及原文引用的演示图片。

audit-validator-independence

Purpose

Detect validators that pass by construction because they copy the target theory's assumptions.

Input contract

yaml
mode_contracts:
  validator: &validator_audit_input
    required: [target_claim, validator, validator_artifacts]
    optional: [data_generation, metric, oracle, acceptance_rule]
    constraints: [validator_assumptions_and_target_assumptions_must_be_separately_listed]
  benchmark: *validator_audit_input
  sandbox: *validator_audit_input
  simulation: *validator_audit_input

Execution protocol

Do not perform called SOP operations inline; each loaded SOP owns its contract and thresholds.

  1. You MUST load skill enumerate-validator-assumptions to enumerate embedded validator assumptions.
  2. You MUST load skill build-noncircularity-matrix to cross-tabulate target and validator assumptions.
  3. You MUST load skill detect-pass-by-construction to detect copied assumptions. You MUST load skill design-falsification-test to design an independent failure channel.

Deviation: if no non-circular channel is feasible, return blocked validation rather than a pass.

Output contract

yaml
mode_contracts:
  validator: &validator_audit_output
    produces: [noncircularity_matrix, red_cell_actions, validator_verdict, adversarial_ground_truth_set]
    delta_fields: [findings, evidence_updates, uncertainties, decisions, open_questions]
  benchmark: *validator_audit_output
  sandbox: *validator_audit_output
  simulation: *validator_audit_output

Thresholds and quality gates

  • At least one validator path must be independent of the target's defining assumptions.
  • Shared or derived-from-target dependencies must be explicit in the matrix.

Failure and counterexamples

Pass-by-construction is a finding, not evidence of corroboration. Unknown dependencies remain unresolved.

Provenance map

  • resolved: circular-validation-audit

Preserved source criteria ledger

sourcesource linekindsource criterion
v4 architecturenode desctextualBuild claim-validator assumption matrix and require a non-circular failure channel.

Context checkpoint / Delta notes

Append assumptions, matrix cells, circularity findings, and proposed independent test.

Mode branches

  • validator: inspect validator implementation assumptions.
  • benchmark: inspect benchmark construction and metric assumptions.
  • sandbox: inspect environment/oracle assumptions.
  • simulation: inspect simulator and initialization assumptions.

按任务相关推荐

来自同一仓库

更多 Skills

全部 Skills