yogsoth-ai/de-anthropocentric-research-engine

audit-data-contamination

Audit train/test leakage, memorization artifacts, temporal leakage, and disclosure pathways that can invalidate evaluation.

View source

How to use

  1. Copy the installation command and review the source package before installing it in your own agent environment.
  2. Check the source document for required tools, credentials and supported hosts.
  3. Describe your input and desired deliverable; review the output against the source material.
npx skills add https://github.com/yogsoth-ai/de-anthropocentric-research-engine --skill audit-data-contamination

Before you start

  • Installation does not include a model subscription, API allowance or permission to access your files.
  • Repository stars and installation counts describe activity, not an independent quality or security test.
Original skill document

Rendered from the source repository. Headings, examples, code, tables, links, and referenced images are preserved.

audit-data-contamination

Purpose

Audit train/test leakage, memorization artifacts, temporal leakage, and disclosure pathways that can invalidate evaluation.

Input contract

yaml
required: [dataset_partitions, training_sources, evaluation_records]
optional: [release_history, deduplication_keys, access_logs]
constraints: [each contamination claim requires a matched record, pathway, and comparison basis]

Procedure

  1. Define partition, temporal, entity, and disclosure boundaries.
  2. Match evaluation items against training and public-source records using declared keys.
  3. Test suspected leakage pathways and compare affected with unaffected cases.
  4. Classify confirmed, plausible, and unassessed contamination with impact notes.

Output contract

yaml
produces: [contamination_matches, pathway_map, affected_case_set, impact_assessment, audit_uncertainties]
delta_fields: [findings, evidence_updates, uncertainties, decisions, open_questions]

Quality gates

  • Matching keys and time boundaries are recorded.
  • False-positive matches are sampled and documented.

Failure and counterexamples

Do not call lexical overlap contamination without a disclosure pathway, and do not infer clean separation from missing metadata.

Provenance map

  • resolved: knowledge-acquisition-contamination-audit

Related by task

from this repository

More skills

All skills