How to Use Massive AI Models (Like GPT-3) in Your Startup - Deepstash
Machine Learning With Google

Learn more about startup with this collection

Understanding machine learning models

Improving data analysis and decision-making

How Google uses logic in machine learning

Machine Learning With Google

Discover 95 similar ideas in

It takes just

14 mins to read

The journey to this point began a little more than 9 years ago with a 2012 submission, called AlexNet, to the annual ImageNet LS

The journey to this point began a little more than 9 years ago with a 2012 submission, called AlexNet, to the annual ImageNet LS

  • Within a year, startups began springing up to replicate AlexNet
  • Fast forward to 2022: Neural networks have changed every aspect of machine intelligence in software systems we all use daily, from recognizing our speech to recommending what's in our news feed
  • Today's systems still employ neural networks - but at a vastly different scale
  • Recent systems for understanding and generating human language, such as OpenAI's GPT-3, were trained on supercomputer-scale resources
  • These new systems require tens of millions of dollars in computation

10

92 reads

Pre-trained neural networks give smaller teams a leg up

  • A neural network is first trained on a large general-purpose dataset using significant amounts of computational resources, and then fine-tuned for the task at hand using a much smaller amount of data and compute resources.
  • The use of pre-trained networks has exploded in recent years as the industrialization of machine learning has taken over many fields and data has increased.

10

86 reads

The risks of foundation models: size, cost, and outsourced innovation

  • One of the risks associated with foundation models is their ever-increasing scale.
  • Pre-training on a large general-purpose dataset is no guarantee that the network will be able to perform a new task on proprietary data.
  • Dataset alignment and recency of training data can matter immensely depending on the use case.

10

50 reads

Cloud APIs are easier, but outsourcing isn't free

  • The cost of API calls, data storage, and cloud instances will scale along with usage.
  • Many companies that have used cloud APIs for machine learning today may eventually attempt to transition to self-hosted or self-trained models to gain more control over their machine learning pipelines.

11

53 reads

Be strategic and keep an eye on the big AI labs

  • Cloud APIs bring their own problems long-term. It's important to have a strategic exit plan so these APIs do not control your product destiny.
  • Keep tabs on what is coming out of the big corporate AI labs.

10

67 reads

CURATED BY

aidenm

I’ll sleep when I am dead.

stash-superman-illustration

Explore the World’s

Best Ideas

200,000+ ideas on pretty much any topic. Created by the smartest people around & well-organized so you can explore at will.

An Idea for Everything

Explore the biggest library of insights. And we've infused it with powerful filtering tools so you can easily find what you need.

Knowledge Library

Powerful Saving & Organizational Tools

Save ideas for later reading, for personalized stashes, or for remembering it later.

# Personal Growth

Take Your Ideas

Anywhere

Organize your ideas & listen on the go. And with Pro, there are no limits.

Listen on the go

Just press play and we take care of the words.

Never worry about spotty connections

No Internet access? No problem. Within the mobile app, all your ideas are available, even when offline.

Get Organized with Stashes

Ideas for your next work project? Quotes that inspire you? Put them in the right place so you never lose them.

Join

2 Million Stashers

4.8

5,740 Reviews

App Store

4.7

72,690 Reviews

Google Play

samz905

Don’t look further if you love learning new things. A refreshing concept that provides quick ideas for busy thought leaders.

Sean Green

Great interesting short snippets of informative articles. Highly recommended to anyone who loves information and lacks patience.

Ashley Anthony

This app is LOADED with RELEVANT, HELPFUL, AND EDUCATIONAL material. It is creatively intellectual, yet minimal enough to not overstimulate and create a learning block. I am exceptionally impressed with this app!

Shankul Varada

Best app ever! You heard it right. This app has helped me get back on my quest to get things done while equipping myself with knowledge everyday.

Laetitia Berton

I have only been using it for a few days now, but I have found answers to questions I had never consciously formulated, or to problems I face everyday at work or at home. I wish I had found this earlier, highly recommended!

Giovanna Scalzone

Brilliant. It feels fresh and encouraging. So many interesting pieces of information that are just enough to absorb and apply. So happy I found this.

Jamyson Haug

Great for quick bits of information and interesting ideas around whatever topics you are interested in. Visually, it looks great as well.

Ghazala Begum

Even five minutes a day will improve your thinking. I've come across new ideas and learnt to improve existing ways to become more motivated, confident and happier.

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving & library

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Personalized recommendations

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates