The Future of Artificial Intelligence: A Look from San Francisco
Leopold Aschenbrenner, a name gaining recognition in the field of artificial intelligence (AI), has worked on the superalignment team at OpenAI. His main goal was to ensure that superintelligent AI systems are aligned with human interests, a crucial task given the complexity and power of these systems. Aschenbrenner also founded an investment firm focused on AGI, supported by prominent figures like Patrick Collison and Nat Friedman. Before focusing on AI, he conducted research on economic growth at Oxford's Global Priorities Institute and graduated as valedictorian from Columbia University at the age of 19.
In his article "Situational Awareness: The Decade Ahead," Aschenbrenner provides a deep insight into the future of AI and the challenges we will face in the next decade. Here, the key points of his analysis are explored.
Exponential Increase in Compute Clusters
Aschenbrenner highlights that the tech industry has seen explosive growth in computing capacity. We have moved from $10 billion compute clusters to figures reaching $100 billion and even trillions of dollars. This increase reflects an unprecedented mobilization of American industrial capacity, with companies competing to secure energy contracts and voltage transformers to sustain this growth.Race to AGI
It is expected that by 2025/26, machines will surpass many college graduates in cognitive ability, and by the end of the decade, they will achieve superintelligence. This development, according to Aschenbrenner, will unleash national security forces not seen in half a century and could lead us to an arms race with China or, in the worst case, a total war.Public Perception and Analysts
Despite the growing conversation about AI, most people do not understand the true impact that is coming. Only a few in San Francisco and AI labs have the appropriate situational awareness to foresee these changes. Aschenbrenner notes that Nvidia analysts and mainstream commentators underestimate the magnitude of the change, seeing it as merely an internet-scale technological evolution.AI Development Trends
The transition from GPT-2 to GPT-4 in four years has taken AI from preschool-level to high school-level capabilities. Based on trends in compute growth and algorithmic efficiencies, another significant qualitative leap is anticipated by 2027, making AGI plausible.From AGI to Superintelligence
AGI will not stop at human level. The automation of AI research by AGIs could accelerate progress, leading to superintelligence in a very short period. This would present dramatic power and peril, as these superhuman AIs could perform complex and creative tasks that humans cannot fully evaluate.Associated Challenges
Aschenbrenner identifies several critical challenges:1. Industrial Mobilization: The construction of infrastructure to support AI will be intense, with trillions of dollars invested in GPUs and data centers.
2. Security in AI Labs: Leading AI labs must significantly improve their security to protect AGI secrets from state threats.
3. Superalignment: Controlling AI systems much smarter than humans is an unresolved technical problem. Failure to manage this challenge could be catastrophic.
4. Global Competition: The competition with China will determine if the free world can maintain its preeminence and avoid self-destruction.
National AGI Project
As the race to AGI intensifies, the U.S. national security state will become more involved. A government AGI project is anticipated by 2027/28, as no startup can handle superintelligence alone.Final Thoughts
The possibility that these predictions are correct implies a profound change in history, comparable to historical figures like Szilard and Oppenheimer. Aschenbrenner concludes that we are at a crucial moment that will define the future of humanity in the age of artificial intelligence.Leopold Aschenbrenner's analysis in "Situational Awareness: The Decade Ahead" offers a revealing and detailed perspective on the upcoming challenges and opportunities in the field of artificial intelligence. His experience and connections in the sector reinforce the credibility of his projections, highlighting the need for preparedness and situational awareness in society and the industries involved.
Sources: For Our Posterity, Fast Company, Situational Awareness