Matt Clifford: The Bull & Bear Case for China's Ability to Challenge the US' AI Capabilities | E1172
01 Jul 2024 (6 months ago)
The Future of AI and Language Models
- The value of adding more compute and data to language models is diminishing, leading to a potential flattening out of progress.
- The focus should shift from scale to finding innovative ideas and approaches, such as search, multimodality, and new AGI techniques.
- Data is currently the bottleneck to further advancements in the LLM space.
- There is still significant potential for growth in AI, particularly in using video and interactive experiences to train models.
- The current hype cycle around AI could lead to stagnation if companies fail to find new and innovative ways to use language models.
- The value of good ideas in AI will increase as the field becomes more commoditized, and companies that can find unique and effective ways to use language models will be the most successful.
- The speaker expresses skepticism about OpenAI's valuation of $90 billion, given the potential for commoditization and the need for continued innovation.
China's AI Landscape
- China is a sophisticated player in AI with the potential to become a leader due to its access to data and prioritization of AI development.
- Chinese AI regulation is strict due to the CCP's focus on stability and fear of destabilization.
- Companies in China are required to provide random samples of training data and demonstrate alignment with CCP positions.
- China's tech industry is tightly controlled, limiting the emergence of individuals like Sam Altman or Demis Hassabis.
- There is an asymmetry in how the West learns about China's AI developments compared to how China learns about the West's.
- US export controls on the semiconductor supply chain have impacted China's ability to build large GPU clusters, potentially slowing their progress in AI.
- The bull case for China is that they may eventually develop domestic capabilities and become independent of foreign technology.
- The bear case for China is that the gap in compute power and access to advanced chips may hinder their progress, allowing the West to maintain a lead.
Trends in the AI Industry
- There is a trend towards verticalization in the AI industry, with companies like Nvidia moving into the model layer and model players like OpenAI exploring chip development.
- The key question is how good the GPT-5 era models will be, with a significant gap between GPT-4 and GPT-5 potentially indicating a qualitative change in AI capabilities.
- The development of reliable agentic models could be a transformative shift, but the world may not be fully prepared for the implications of such powerful AI systems.
- The speaker predicts a rise in the use of autonomous agents in various sectors of the economy in the next 5 years.
- Infrastructure is needed to maximize the economic value of these agents, similar to the infrastructure built for high-frequency trading.
- Whoever builds the protocol that allows agents to transact with each other will own a valuable asset.
Societal Impact of AI
- The speaker expresses concern about knowledge inequality and the potential for a widening wealth gap due to the increasing use of AI.
- Despite this, the speaker believes that technology has historically been a positive force for prosperity and that the benefits of AI will outweigh the challenges.
- The speaker criticizes the EU's approach to AI regulation, arguing that it stifles innovation, while the UK has a more favorable regulatory environment for AI development.
- The speaker believes that the UK has a strong talent base and research capabilities in AI, making it an attractive location for building and scaling technology companies.
- The speaker believes that the UK can regain its position as one of the richest countries in the world per capita by becoming the obvious place to build and scale technology companies.
- The speaker identifies the vetoing of data center construction by local councils as a major obstacle to investment in the UK's compute infrastructure.
- The UK has a strong life sciences cluster, a radical government R&D funding agency, and expertise in building successful companies.
- However, UK pension funds are not investing in UK venture capital, which means that the benefits of growth are going to foreign investors.
- AI will change the future of warfare, potentially benefiting non-state actors more than established powers.
- Cybersecurity will become increasingly important in a world of deep fakes and other potential threats.
- Technological progress is not inevitably good and must be carefully managed to avoid negative consequences.
- Defensive technologies are needed to mitigate the risks of powerful technologies falling into the wrong hands.
Entrepreneurship and Talent
- The speaker discusses the importance of defending values and ways of life in the current geopolitical climate.
- The speaker emphasizes the significance of peak performance and exceptional talent in entrepreneurship, highlighting the need for both individual abilities and synergies within founding teams.
- The speaker notes that founding teams often change over time due to self-discovery and evolving interests, which can impact the importance of synergies in the long term.
- The speaker questions the notion that everyone has the ability to be an entrepreneur, comparing it to professions like medicine and suggesting that entrepreneurship requires a high level of skill and expertise.
- The speaker criticizes academic literature on entrepreneurship for lacking practical value and suggests that forced entrepreneurs, those who start companies due to economic circumstances, often perform better than those who choose entrepreneurship voluntarily.
- The speaker highlights the importance of attracting the most talented and ambitious individuals into entrepreneurship, emphasizing the need for a cultural shift where entrepreneurship is seen as a more aspirational career path compared to traditional high-paying jobs.
- The speaker acknowledges improvements in the UK ecosystem but stresses the need for further change to encourage exceptional talent to pursue entrepreneurship rather than opting for lucrative opportunities in finance.
Matt's Personal Insights
- EF initially funded people straight out of university but later realized that more experienced individuals were not necessarily the best fit.
- The company has a two-phase process: a common sense phase where teams are formed and an evaluation phase where half of the teams are cut.
- Charlie Son is the most respected and influential FR investor due to his talent spotting abilities and his skill in pitching back the most ambitious version of a founder's idea.
- Founders can start companies with strangers, challenging the conventional wisdom that emphasizes starting companies with people they know.
- The speaker has changed his mind about AGI companies and now believes that the most ambitious founders should consider building them.
- Fatherhood is challenging and requires investment and effort to build strong relationships with children.
- Matt is often asked about his immersive murder mystery games during interviews.
- He believes that most people have a desire to experience alien environments and be someone else without consequences.
- His historical murder mystery games allow players to make choices and determine the outcome of the evening, without any predetermined results.
- Matt finds great enjoyment in both playing and writing these games, as they satisfy a unique human desire that few other activities can.
- The creator economy is still thriving, and Matt encourages others to pursue their passions and creativity.