Do you recall the part where I mentioned key people implementing safety measures to protect their lofty goals by isolating the company from external influences like superpower investors, various political situations, and even the founders themselves?

The Big Dilemma

<ul><li>AI is old stuff, having been studied at universities by researchers since the 1950s.</li><li>In the last 10 years, big tech companies have realized AI's power and started working on it for their own benefits.</li><li>These companies, including Google, Amazon, Meta, and Microsoft, quickly adopted new strategies to transfer talent from universities, paying lucrative salaries, and also acquiring AI research companies.</li></ul>

Let's zoom out

Companies like Meta are open-sourcing (rather than commercialize) their AI models, claiming to democratize AI. However, they never share the data used to train these models. This attitude creates a significant barrier for other researchers who wish to analyze, understand and, shepherd these AI models.

Bonus-2: Democratize(!?) AI

⚠️

AI community is broadly divided into two ideological camps:<ol><li>Techno-optimists: Most entrepreneurs & business people support unbounded development of AI. They have a commercial vision. Move fast, get more money in, quickly build and release products for public use.</li><li>Existential-risk Advocates: Most scientists & researchers support AI containment. AI safety is the utmost priority for them. Move cautiously, make sure it's completely tested against potential risks and do not release products until they're resistant to misuse and misbehave.</li></ol>We'll see who prevail and what the consequences will be. Soon<warningtag>.</warningtag>

Who will prevail?

I dropped out of my PhD study while working on my thesis in AI. Those were the days AI was not a buzzword and my SVM models were outperforming NN models. I quit to start my own business, immersing myself in both academic and startup cultures. Wearing both hats in the past has been invaluable. From this perspective, I believe AI needs to be managed with great caution. Because it's a huge challenge (in fact impossible) to predict the complete outcomes of an autonomous and self-improving technology.

My two cents

Co-founder Ilya Sutskever, a successful scientist, has groundbreaking papers published as a researcher. He's well aware of the threats of the coming AI wave and wants to ensure every improvement is safe and useful for humanity.Ilya's vision was that creating AGI is possible by scaling the tech stack (with more data and larger infrastructure), but this requires a substantial amount of money for hardware and to attract talent.Consequently, securing investment became a necessity.

OpenAI Co-Founders — Ilya Sutskever 

AI safety does not only mean as extreme as preventing existential risks or national security threats. When you think of AI safety, remember that it also relates to avoiding discrimination and bias in any form. Ethics and misinformation are critical components that require proactive management to mitigate AI's potential adverse effects on society.

Bonus-3: AI Ethics

Simultaneously, Satya Nadella (CEO of Microsoft), offered a guaranteed position to all OpenAI staff at Microsoft. It was a reasonable move because Microsoft put billions in OpenAI and didn't want to lose it all of a sudden.Over 700 out of 770 employees signed a letter that threatens to quit unless Sam Altman was reinstated.Without employees there is no company. This made the board reverse their decision and despairingly call Sam Altman back to his position.This is the end of drama.

OpenAI Employees (cont'd)

This was where non-profit to for-profit transformation happened (2019) and Sam Altman joins as CEO. They altered the corporate structure.Although they shifted towards a Silicon Valley startup model, they still maintained their strict rules to prevent possible misleading and drift from the initial objectives. Measures were implemented to avert investor involvement in management and to limit investor profits. Additionally, founders were not allowed to hold any equity in the company.Sam Altman is an expert in Silicon Valley startup culture, which emphasizes moving fast and growing infinitely.

OpenAI Co-Founders — Sam Altman

OpenAI was successful to bring skilled people into the company by emphasizing altruistic reasons — working for the benefit of humanity. Employees care about humankind but also their state of mind. They became distraught after the chaos began, as they never received any explanation about what was happening, leading to significant anger and a feeling of being left in the dark.The other thing they care is their pockets. Their financial expectations were slipping into dangerous territory. Nobody wanted to see the company's skyrocketing valuation take a downturn due to a fiasco.

OpenAI Employees

OpenAI has faced similar challenges in the past. In early 2018, a disagreement between Sam Altman and Elon Musk led to Musk completely withdrawing his support and exiting the company.Furthermore, a dispute over the commercialization of GPT-3 prompted the departure of senior scientist Dario Amodei, who took along a significant portion of the team to found Anthropic, now a major competitor to OpenAI.

Bonus-1: Not the First Time

Everyone has a plan 'till they get punched in the face.

On November 17th, Sam Altman, CEO of OpenAI (creator of ChatGPT and world's hottest AI company), was fired by the board without any explanation to stakeholders, leading to significant drama.Numerous conspiracies and speculations emerged. After cycling through three CEOs in under a week, the company reverted to its original CEO, and the initial board stepped down.

What happened?

<ul><li>OpenAI was founded in 2015 as a non-profit research organization aimed at developing AGI for the benefit of humanity, in response to the rise of AI developments by those companies. This is why Elon Musk joined and donated $10M.</li><li>AGI means AI reaching and overtaking human capabilities in every area of life, capable of improving itself autonomously and recursively. In the extreme (hyperintelligence), it's a God. It can know and do everything.</li><li>OpenAI aimed to mitigate these existential risks facing humanity: AI safety and ethics must be secured, and all discoveries should follow open standards!</li></ul>

Artificial General Intelligence (AGI)

Co-founder Greg Brockman, sharing an entrepreneurial mindset and background with Sam Altman, is also a hustler. That's the reason for their deep mutual solidarity.Sam Altman secured significant funding from Microsoft, but his entrepreneurial approach began to pose risks and inconsistencies with OpenAI's foundational principles.On November 17th 2023, the board fired Sam for straying from their main altruistic mission. Greg immediately resigned in support of him. This was followed by the resignation of three senior employees.

OpenAI Co-Founders — Greg Brockman

When AI governance is concerned, self-regulation does not work!

Moral of the Story

You're familiar with ChatGPT, but how well do you know the company behind it? Let’s dive in OpenAI’s latest implosion and explain it from a broad perspective, examining AI's past, its future, and the challenges along the way.

You know ChatGPT, but how much do you know about the company that made it? Journalist Karen Hao joins us to talk OpenAI’s latest implosion.

Subscribe to Big Think on YouTube ► https://www.youtube.com/channel/UCvQECJukTDE2i6aCoMnS-Vg?sub_confirmation=1

Journalist Karen Hao joins Big Think’s Editor-in-Chief, Robert Chapman-Smith, to discuss the recent events at OpenAI, including the ousting and reinstatement of CEO Sam Altman, as well as the ideological clashes regarding the development and release of powerful AI models like ChatGPT.

---------------------------------------------------------------------------------- 

Background Context on OpenAI:
The inside story of Microsoft's partnership with OpenAI, Charles Duhigg for The New Yorker ► https://www.newyorker.com/magazine/2023/12/11/the-inside-story-of-microsofts-partnership-with-openai
Inside OpenAI’s chaos, Karen Hao and Charlie Warzel for The Atlantic  ►  https://www.theatlantic.com/technology/archive/2023/11/sam-altman-open-ai-chatgpt-chaos/676050/
OpenAI profile, Ross Andersen for The Atlantic ► https://www.theatlantic.com/magazine/archive/2023/09/sam-altman-openai-chatgpt-gpt-4/674764/
OpenAI profile, Karen Hao for MIT Technology Review  ►  https://www.technologyreview.com/2020/02/17/844721/ai-openai-moonshot-elon-musk-sam-altman-greg-brockman-messy-secretive-reality/

Background Context on how AI works:
How Large Language Models Work, Andrej Karpathy  ► https://www.youtube.com/watch?v=zjkBMFhNj_g
What is ChatGPT Doing and Why Does It Work?, Stephen Wolfram  ► https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/
Are Conscious Machines Possible?, Michael Wooldridge for Big Think  ► https://www.youtube.com/watch?v=uf6zZfLat-8
There is no AI, Jaron Lanier  ► https://www.newyorker.com/science/annals-of-artificial-intelligence/there-is-no-ai

Background Context on accelerating AI:
Why AI will save the world, Marc Andreessen ► https://a16z.com/ai-will-save-the-world/
My Techno-Optimism, Vitalik Buterin  ► https://vitalik.eth.limo/general/2023/11/27/techno_optimism.html
Are AI Risks Overhyped?, Andrew Ng  ► https://www.deeplearning.ai/the-batch/issue-220/
To fear AI is to fear Newton and Einstein, Rohit Krishnan for Freethink  ► https://www.freethink.com/robots-ai/dreams-of-utopia

Background Context on AI risk:
AI risk does not equal AGI risk, Gary Marcus  ► https://garymarcus.substack.com/p/ai-risk-agi-risk
AI pioneer calls to stop AI before it's too late, Stuart Russell for Freethink  ► https://www.youtube.com/watch?v=EOyljx7Pi7A
Why the Godfather of AI fears what he's built, Joshua Rothman, forThe New Yorker  ► https://www.newyorker.com/magazine/2023/11/20/geoffrey-hinton-profile-ai
On the dangers of Stochastic Parrots: Can Language Models Be Too Big?, Emily Bender, Timnit Gebru, et al  ► https://youtu.be/N5c2X8vhfBE?si=xS3B5NCk5np-ghDD

Books on AI:
AI 2024: Ten Visions for Our Future, Kai-Fu Lee  ► https://a.co/d/61BHsfW
The Worlds I See, Dr. Fei-Fei Li  ► https://www.momentoflift.com/the-worlds-i-see
The Coming Wave, Mustafa Suleyman  ► https://bigthink.com/the-future/technology-unintended-consequences-containment/
Weapons of Math Destruction, Cathy O’Neil ► https://www.penguinrandomhouse.com/books/241363/weapons-of-math-destruction-by-cathy-oneil/

---------------------------------------------------------------------------------- 

About Karen Hao:
Karen Hao is an award-winning journalist covering artificial intelligence, currently contributing to The Atlantic. Previously, she was a foreign correspondent at The Wall Street Journal focused on AI, China tech & society, and a senior editor at MIT Technology Review, where she wrote about the latest AI research & its social impacts. She was also a fellow with the Harvard Technology and Public Purpose program, the MIT Knight Science Journalism program, and the Pulitzer Center’s AI Accountability network.

strategy

Strategy

entrepreneurship

Entrepreneurship

business

Business

artificialintelligence

Artificial Intelligence

leadershipandmanagement

Leadership & Management

Big Think is the leading source of expert-driven, actionable, educational content -- with thousands of videos, featuring experts ranging from Bill Clinton to Bill Nye, we help you get smarter, faster. Get actionable lessons from the world’s greatest thinkers & doers. Our experts are either disrupting or leading their respective fields. We aim to help you explore the big ideas and core skills that define knowledge in the 21st century, so you can apply them to the questions and challenges in your own life. Other Frequent contributors include Michio Kaku & Neil DeGrasse Tyson.

Head to bigthink.com for a multitude of articles just as informative and satisfying as our videos. New articles posted daily on a range of intellectual topics. ​Join Big Think+ to gain access to an immense library of content. It features insight from many of the most celebrated and intelligent individuals in the world today.

   - Subscribe for daily videos.
   - Business inquiries and fan suggestions welcome.

Artificial General Intelligence (AGI)

Similar ideas to Artificial General Intelligence (AGI)

The Road to Artificial General Intelligence