Variance-Invariance-Covariance Regularization for Self-Supervised Learning - Deepstash
Self-Supervised Learning

Labelled data is expensive, which makes benefiting from the current success in supervised learning unfeasible for smaller companies.

However, good representations can be learned without any ...

4

STASHED IN:

6

Variance-Invariance-Covariance Regularization for Self-Supervised Learning

arxiv.org

STASHED IN:

0 Comments

Quality of Representations

Good representations are expressive and make efficient use of the given dimensionality.

We want the representations to be variant to contextual changes that are essential to a task and invari...

1

STASHED IN:

6

VICReg

While many recently proposed self-supervised learning algorithms prevent a collapse of the embedding-space implicitly through various methods like contrasting samples in a batch [

1

STASHED IN:

6

Deepstash helps you become inspired, wiser and productive, through bite-sized ideas from the best articles, books and videos out there.

GET THE APP: