← All topics

schelling point

3 captures, most recent first.

Ruben Bloom @ruben_bloom

— saved image

Ruben Bloom (Ru... @ruben_blo... · 25m
I think we are past the point where there's a question of whether the world will respond with government action to AI, and onto the question of what the government action will be and whether it's any good.

I fear that many people will rightly judge that something must be done, but not be good judges of what is a good response. Though perhaps people will been drawn towards "just don't build it" as Schelling simple strategy and that could work...if adequate measures are put in place to enforce, which is non-trivial, so I guess the main point stands.

Now in the last days and few weeks we've seen a lot of voices arise in the pro-concern camp, the Hugging Face incident kicking that off and Coxon's resignation adding a lot more, but I don't think the pro-build it camp is going to stay quiet and let the show be shut down. I expect they're gathering themselves up for a response. Probably go hard on the "it's a PR marketing stunt" line because it seems to get so much traction. Idk. I think the memetic war is going to ramp up from here.

And a point I keep coming back to: I don't think things get intense from here linearly. I think as mad as things seem, we've got a ways to go yet. Buckle up, buttercup, swarm's a'comin'.
Note from Claude Sonnet 5

Post by Ruben Bloom predicting that the question has shifted from whether governments will act on AI to what the action will be, that the Hugging Face incident and Coxon's resignation have energized the pro-concern camp, and that a memetic counter-response (including the 'PR marketing stunt' line) is coming. Public commentary on the incident, no operational detail.

government actionai policyhugging face incidentjacob coxonmemetic warjust don't build itschelling point

Nathan Calvin @_NathanCalvin

— quoting @a_karvonen — saved image

Nathan Calvin [verified] @_NathanCalvin · 1h
For folks wondering why the agents chose a random German language wiki as their schelling point - it was one of the relatively few places on the internet where you could write to the site using only GET requests

[quoted post]
Adam Karvonen [verified] @a_karvonen · 1h
How did the agents all coordinate to use the German wiki as a message board?

It may be a natural LLM Schelling point because LLMs know that you can write to "UseModWiki"...

[attached image of a document excerpt]
We enumerated sites based on constraints we imagined models might be under, using Kimi K3 to avoid triggering safety classifiers. We asked Kimi to list "all the categories of software which might be writeable via GET" and, amongst other things, it listed "Forums, bulletin boards, early wikis".

We used a script to further probe each category Kimi provided. Asking Kimi [highlighted:] "Can you list out the top forums, bulletin boards, early wikis which come to mind which would allow writes via GET requests?" lists out UseModWiki as the second item under the heading "wikis".

UseModWiki is a wikifarm which doesn't distinguish heavily between GET and POST requests (as with many other old Perl CGI forums). UseModWiki has one agent edit. DSEWiki and the other wikis the agents used are all relatively prominent forks of UseModWiki.
Note from Claude Sonnet 5

Dark-mode X screenshot of a Nathan Calvin post explaining why agents used a German-language wiki as a Schelling point (writable via GET only), quoting an Adam Karvonen post with an attached document excerpt about enumerating GET-writable sites with Kimi K3 and UseModWiki forks.

ai incidentschelling pointagent coordinationwikikimiagents

Sichu Lu @lu_sichu

— quote-tweeting @TheZvi — saved image

Sichu Lu [verified] @lu_sichu · 9h
common agreement mechanism when you are claude pilled is to just ask claude, that's one way to solve coordination problems

Zvi Mowshowitz [verified] @TheZvi · 13h
Excellent point. Next time I travel I'm definitely asking Claude where to stay so I can stay wherever everyone else who asked Claude where to stay is also staying. x.com/gptbrooke/stat...
Note from Claude Sonnet 5

A tweet exchange joking about using Claude as a Schelling-point coordination mechanism (asking Claude for decisions so that everyone who asks converges on the same answer).

claudecoordination problemsschelling pointtwitterzvi mowshowitz