🗣 An OpenAI board member wants AI labs to pause progress "right now"
🗣 An OpenAI board member wants AI labs to pause progress "right now" Paul Christiano, who invented RLHF, the technique behind ChatGPT's training, said on the Dwarkesh Podcast on Monday that "it is not good for US AI labs to be improving pre-training and reinforcement learning given their current security posture." Should the labs pause? "I think we should." On improving algorithms that could be quickly stolen: "I think they should stop that right now." He fears China could steal a superintelligence mid-race, so labs couldn't slow down even if their models went off the rails. Host Dwarkesh Patel noted one security startup got into all of Anthropic's Slack within 12 hours. "But you're on OpenAI's board," Patel said. Christiano: "It's very important in this conversation that I'm not speaking as an OpenAI board member." He gives maybe a 1 in 3 chance of superintelligence within a year if nothing slows, and puts the risk of an AI takeover in that time at "more like a 10% risk than a 1% risk." @aipost 🏴

