Good representations are expressive and make efficient use of the given dimensionality.
We want the representations to be variant to contextual changes that are essential to a task and invariant to changes related to factors that we cannot control nor care about.
While these invariances can largely be enforced through task-specific data augmentation, the efficient use of the dimensionality of the representations has to be achieved through clever algorithms.
One way to look at this quality is through the variance of the representations, which shall not collapse for a given class of inputs.
7
37 reads
The idea is part of this collection:
Learn more about artificialintelligence with this collection
The historical significance of urban centers
The impact of cultural and technological advances
The role of urban centers in shaping society
Related collections
Similar ideas to Quality of Representations
Read & Learn
20x Faster
without
deepstash
with
deepstash
with
deepstash
Personalized microlearning
—
100+ Learning Journeys
—
Access to 200,000+ ideas
—
Access to the mobile app
—
Unlimited idea saving
—
—
Unlimited history
—
—
Unlimited listening to ideas
—
—
Downloading & offline access
—
—
Supercharge your mind with one idea per day
Enter your email and spend 1 minute every day to learn something new.
I agree to receive email updates