Contrastive Learning - Deepstash

📔

Contrastive Learning

4 STASHED IDEAS

Quality of Representations

Good representations are expressive and make efficient use of the given dimensionality.

We want the representations to be variant to contextual changes that are essential to a task and invariant to changes related to factors that we cannot control nor care about. 

While these invariances can largely be enforced through task-specific data augmentation, the efficient use of the dimensionality of the representations has to be achieved through clever algorithms.

One way to look at this quality is through the variance of the representations, which shall not collapse for a given class of inputs. 

1

STASHED IN:

6

Add ideas to your stash.

When you see an idea you like stash it! This will add the idea to your own stash, building your knowledge library.

In this way, you can easily find ideas later.

To stash - tap on the stash icon. Give it a try with this idea.

285

STASHED IN:

596

STASHED IN:

18 Comments