— quoting @kickingkeys — saved image
Ker Lee Yap @klyap_ · Aug 23 Some cool learnings i got from this blog: - don't do rubric judge scoring 1-10, just do pairwise comparisons - you can just handpick a golden set and compare outputs to a random one from there instead of a reward model - simple prompts are better, dont add too much detailed specs [quoted tweet] Surya @kickingkeys · Aug 23 You can just RL a coding model to paint with javascript btw [embedded video, 0:09, paused: generative artwork on a black background showing translucent white-and-red flower forms with thin purple and orange curving lines and small green leaf shapes]
Note from Claude Sonnet 5
Tweet by Ker Lee Yap summarizing three lessons from a blog on RL with model-based judging (pairwise comparison over 1-10 rubric scoring, a handpicked golden set instead of a reward model, simple prompts), quoting a Surya tweet about RL-training a coding model to paint with JavaScript. The quoted video shows generative flower artwork.
rlllm judgepairwise comparisonreward modelgenerative artcoding models