← All topics

science methodology

2 captures, most recent first.

@ChrisGPotts

— saved image

Christopher Potts ✔️ @ChrisGPotts · 12m
Every successful scientific project eventually enters a battle-testing phase in which the team is actively trying to show that their results don't hold. In a new post, @mmooritz and I describe how to ensure that this key process flourishes in an era of agentic science.
1 reply, 20 bookmarks/views icon, 1 like

Christopher Potts ✔️ @ChrisGPotts · 12m
Our method adapts adversarial coding review by fresh-context agents to the scientific process. The key change is to shift from "find all the bugs" to "what could manufacture this result?"
Note from Claude Sonnet 5

Tweet thread from Christopher Potts (with @mmooritz) introducing a method for adversarial 'battle-testing' of scientific results using fresh-context AI agents, reframing code review from bug-finding to asking what could have manufactured a given result.

ai agentsscience methodologytwitteragentic science

Douglas Yao @DouglasYaoDY

— quoting Nature Biotechnology (@Natu...)

Douglas Yao @DouglasYaoDY · May 2 The figure in this article illustrates exactly how most biology papers are secretly p-hacked. A large number of hypotheses is explored, and only the ones that form a coherent story are reported. This is actually the main reason behind the replication crisis in biology IMO. [Embedded figure: "Fig. 1: Project design and evolution." Three branching tree diagrams labeled a) Plan, b) Process, c) Publication. Caption: "a, Project plan. b, Actual process. c, Publication."] > QUOTED: Nature Biot... @Natu... · Apr 30 Discovery requires an openness to new ideas and unexpected insights go.nature.com/4i1wQf5 rdcu.be/ej7H7
Note from Claude Sonnet 5

A tweet on the biology replication crisis, arguing that exploratory research trees get pruned post-hoc into a "coherent story" in publications — an implicit form of p-hacking. General science-methodology content, tangential to Nathan's own research practices but not AI-specific.

twitterreplication crisisbiologyp-hackingscience methodologypublication bias