We must slowdown there is no other way we make it through this. I am sure you guys have already contacted the AGI pilled new Congress people who will join soon but if not I think you should try and meet with them and explain this paper.
It has to be the government. The psychos at the labs clearly understand the risks, but even when they discuss them you can tell how enamored they are of their own bullshit/celebrity/zealous pseudo-philosophy. Roon is a prime example of this. I think they’re high as a kite and have no desire to stop.
Tragically, they are the only ones in the world who actually want any of this, but also basically the only ones who realize how bad it is.
"Our overall opinion is that if SAR is coming in 2027, an industry-wide pause on AI R&D should be the top priority for the AI industry, the US government, and the entire world."
In terms of operationalizing a slowdown, do you think it would be enough to require verified internal inference on only released models (with something like FlashProve https://www.anthropic.com/research/provable-inference)? To me this would cut down on RSI risk substantially without requiring hardware changes, which seem impossible in the time span we have. But maybe this does not go far enough.
We must slowdown there is no other way we make it through this. I am sure you guys have already contacted the AGI pilled new Congress people who will join soon but if not I think you should try and meet with them and explain this paper.
It has to be the government. The psychos at the labs clearly understand the risks, but even when they discuss them you can tell how enamored they are of their own bullshit/celebrity/zealous pseudo-philosophy. Roon is a prime example of this. I think they’re high as a kite and have no desire to stop.
Tragically, they are the only ones in the world who actually want any of this, but also basically the only ones who realize how bad it is.
I agree that the government must get involved for us to have this work out.
"Our overall opinion is that if SAR is coming in 2027, an industry-wide pause on AI R&D should be the top priority for the AI industry, the US government, and the entire world."
In terms of operationalizing a slowdown, do you think it would be enough to require verified internal inference on only released models (with something like FlashProve https://www.anthropic.com/research/provable-inference)? To me this would cut down on RSI risk substantially without requiring hardware changes, which seem impossible in the time span we have. But maybe this does not go far enough.
Also, just, yeesh. Thanks for doing this work.
The link to the example trajectory appears to be password protected.
Jesus
One question. Has anyone examined the relationship between the (apparent) step change in improvement and US GDP?