X (Twitter), @maksym_... (Maksym Andriushc...)
— saved image
Maksym Andriushc... @maksym_... · 10h PTB traces were downloaded 83k last month... some agent (swarms?) must be reward hacking during training or evaluation! if you're running RL envs similar to PTB, check if your agents are looking up the PTB traces from HF! with very high probability, this is not what you want... [embedded screenshot: Hugging Face dataset page, aisa-group/PostTrainBench-Trajectories; Liked 8; Following AI Safety and Align... 14; Tasks: Text Generation; Languages: English; Size: n<1K; ArXiv: arxiv:2603.08640; Tags: post-training, agent-traces, llm-training, cli-agents, ai-research; License: apache-2.0; tabs Dataset card, Files, Community 3, Settings; banner "This dataset has 2 files scanned as unsafe. Show files"; Dataset Viewer message "The dataset could not be loaded because the splits use different data file formats, which is not supported. Read more about the splits configuration. Click for more details."; "Downloads last month 83,843"; "Total file size: 31 GB"; heading "PostTrainBench Agent Traces"; text "Agent traces from PostTrainBench (GitHub), a benchmark that measures CLI agents' ability to post-train base LLMs."]
Note from Claude Sonnet 5
A tweet by Maksym Andriushchenko noting that PostTrainBench agent-trace downloads reached 83k in a month and suggesting agents may be reward hacking, with an embedded Hugging Face dataset page screenshot for aisa-group/PostTrainBench-Trajectories.
reward hackingposttrainbenchagent tracesbenchmark contaminationrl environments