Gwern on creating your own AI race and China's Fast Follower strategy.
webAuthor
Credibility Rating
Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.
Rating inherited from publication venue: EA Forum
A curated EA Forum discussion of Gwern's arguments about how AI publication norms and China's fast-follower approach interact to shape global AI race dynamics, relevant to debates on open versus closed AI development.
Forum Post Details
Metadata
Summary
This EA Forum post discusses Gwern's analysis of how AI development creates race dynamics and examines China's 'fast follower' strategy in AI, where China benefits from copying and rapidly iterating on Western AI breakthroughs rather than pioneering them. The post raises concerns about how Western AI labs may inadvertently accelerate a competitive AI race with geopolitical implications.
Key Points
- •Gwern argues that publishing AI research openly may create or accelerate an AI race by giving fast-follower nations like China free access to hard-won breakthroughs.
- •China's fast follower strategy involves letting Western labs do expensive foundational research, then rapidly deploying and scaling the results at lower cost.
- •The dynamic raises questions about whether openness in AI research is net positive given geopolitical competition and safety considerations.
- •Racing dynamics between the US and China in AI could pressure labs to deprioritize safety in favor of speed.
- •The post connects individual lab decisions about publication and openness to broader systemic risks of uncontrolled AI competition.
Cached Content Preview
# Gwern on creating your own AI race and China's Fast Follower strategy.
By Larks
Published: 2024-11-25
Gwern recently wrote a very interesting thread about Chinese AI strategy and the downsides of US AI racing. It's both quite short and hard to excerpt so here is almost the entire thing with very minimal editing:
> Hsu is a long-time China hawk and has been talking up the scientific & technological capabilities of the CCP for a long time, saying they were going to surpass the West any moment now, so I found this interesting when [Hsu explains that](https://www.manifold1.com/episodes/letter-from-shanghai-reflections-on-china-in-2024-73/transcript):
>
> 1. the scientific culture of China is 'mafia' like (Hsu's term, not mine) and focused on legible easily-cited incremental research, and is against making any daring research leaps or controversial breakthroughs...
>
> *but* is capable of extremely high quality world-class followup and large scientific investments given a clear objective target and government marching orders
>
> 2. there is no interest or investment in an AI arms race, in part because of a "quiet confidence" (ie. apathy/laying-flat) that if anything important happens, China can just catch up a few years later and win the *real* race. They just aren't doing it. There is no Chinese Manhattan Project. There is no race. They aren't dumping the money into it, and other things, like chips and Taiwan and demographics, are the big concerns which have the focus from the top of the government, and no one is interested in sticking their necks out for wacky things like 'spending a billion dollars on a single training run' without explicit enthusiastic endorsement from the very top.
>
> Let the crazy Americans with their fantasies of AGI in a few years race ahead and knock themselves out, and China will stroll along, and scoop up the results, and scale it all out cost-effectively and outcompete any Western AGI-related stuff (ie. be the BYD to the Tesla). The Westerners may make the history books, but the Chinese will make the huge bucks.
>
>
> So, this raises an important question for the arms race people: if you believe it's OK to race, because even if your race winds up *creating* the very race you claimed you were trying to avoid, you are still going to beat China to AGI (which is highly plausible, inasmuch as it is easy to win a race when only one side is racing), and you have AGI a year (or two at the most) before China and you supposedly "win"... *Then what?*
>
> 1. race to AGI and win
> 2. trigger a bunch of other countries racing to their own AGI (now that they know it's doable, increasingly much about how to do it, can borrow/steal/imitate the first AGI, and have to do so "before it's too late")
> 3. ???
> 4. profit!
>
> What does winning look like? What do you do next? How do you "bury the body"? You get AGI and you show it off publicly, Xi blows his stack as he realizes how badly he screwed up st
... (truncated, 4 KB total)4a6a2385646470e5 | Stable ID: sid_U9WZu34kon