Ilya Sutskever, a prominent figure in the AI research community and one of the founders of OpenAI, recently announced the launch of his new venture, Safe Superintelligence Inc. This new company, founded by Sutskever and his co-founders Daniel Gross and Daniel Levy, is solely focused on the safe development of “superintelligence” – AI systems that surpass human intelligence.
In a statement, Sutskever and his co-founders emphasized that Safe Superintelligence Inc. is committed to prioritizing safety and security over short-term commercial pressures. The company’s business model is designed to ensure that their work on developing superintelligence is not hindered by management overhead or product cycles. With roots in Palo Alto, California, and Tel Aviv, Safe Superintelligence Inc. aims to recruit top technical talent to achieve their objectives.
Sutskever’s decision to start Safe Superintelligence Inc. was influenced by his previous experiences at OpenAI, where he led a team dedicated to developing artificial general intelligence (AGI). Following his departure from OpenAI, Sutskever mentioned that he had plans for a project that held personal significance to him. His departure, along with the resignation of his team co-leader Jan Leike, prompted discussions within OpenAI about the prioritization of AI safety over commercial interests.
Furthermore, the unsuccessful attempt to remove CEO Sam Altman and the subsequent internal turmoil at OpenAI underscored the importance of creating a company like Safe Superintelligence Inc. that is steadfastly focused on ensuring the safe advancement of AI technology. While OpenAI later established a safety and security committee, questions remained about the effectiveness of such measures, particularly in light of criticisms from former employees like Leike.
As Safe Superintelligence Inc. embarks on its mission to develop superintelligence in a safe and responsible manner, the company’s founders are dedicated to upholding their commitment to prioritizing safety over profit-driven motives. With the creation of Safe Superintelligence Inc., Sutskever and his team are determined to make significant contributions to the field of AI research while remaining vigilant about potential risks associated with advanced AI systems.
Leave a Reply