The risks of foundation models: size, cost, and outsourced innovation
- One of the risks associated with foundation models is their ever-increasing scale.
- Pre-training on a large general-purpose dataset is no guarantee that the network will be able to perform a new task on proprietary data.
- Dataset alignment and recency of training data can matter immensely depending on the use case.
14
69 reads
CURATED FROM
IDEAS CURATED BY
The idea is part of this collection:
Learn more about startup with this collection
Understanding machine learning models
Improving data analysis and decision-making
How Google uses logic in machine learning
Related collections
Read & Learn
20x Faster
without
deepstash
with
deepstash
with
deepstash
Personalized microlearning
—
100+ Learning Journeys
—
Access to 200,000+ ideas
—
Access to the mobile app
—
Unlimited idea saving
—
—
Unlimited history
—
—
Unlimited listening to ideas
—
—
Downloading & offline access
—
—
Supercharge your mind with one idea per day
Enter your email and spend 1 minute every day to learn something new.
I agree to receive email updates