Suggestions
Andrew Critch
Research Scientist, EECS
Andrew Critch is a prominent research scientist affiliated with the University of California, Berkeley, specifically within the Department of Electrical Engineering and Computer Sciences (EECS) and the Center for Human-Compatible AI (CHAI). He works part-time at CHAI, dedicating approximately one day a week to research activities while also serving as the CEO of Encultured AI, a company he co-founded that focuses on artificial intelligence applications.135
Academic Background
Dr. Critch earned his Ph.D. in mathematics from UC Berkeley, where he specialized in algebraic geometry and its applications to machine learning models. His doctoral research was supervised by Bernd Sturmfels, and he has co-founded several initiatives, including the Center for Applied Rationality (CFAR), which aims to improve rational decision-making through workshops based on cognitive science.146
Professional Experience
Before his current roles, Critch worked as a quantitative trader at Jane Street Capital in New York City and held a research fellowship at the Machine Intelligence Research Institute. His diverse background includes offers for faculty positions in mathematics and mathematical biosciences, reflecting his extensive expertise in both theoretical and applied aspects of mathematics and AI.125
Research Interests
Critch's research primarily focuses on logical uncertainty, open-source game theory, and addressing the dynamics of competition among AI developers, which he believes could lead to existential risks for humanity. He is particularly concerned with how AI systems may interact in competitive environments without adequate safety measures.236 He co-authored a significant paper titled "AI Research Considerations for Human Existential Safety," which discusses the implications of AI development on human safety and existential risk.2
Contributions to AI Safety
In addition to his research, Critch is actively involved in various initiatives aimed at promoting long-term safety in AI development. He volunteers for organizations like the Berkeley Existential Risk Initiative and the Survival and Flourishing Fund, where he contributes his expertise to projects focused on mitigating risks associated with advanced technologies.145
Overall, Andrew Critch is recognized for his contributions to both theoretical mathematics and practical applications in AI, emphasizing the importance of safety and ethical considerations in technology development.