What AI says about detect-pretrain-code-contamination

Detect Pretrain Code Contamination is a repository that provides scripts for detecting pretraining code contamination in datasets. It allows users to analyze datasets like truthful_qa and cais/mmlu, outputting a contamination metric where results below 0.1 with a percentage above 0.85 indicate high likelihood of dataset training.