Ideas from books, articles & podcasts.
Labelled data is expensive, which makes benefiting from the current success in supervised learning unfeasible for smaller companies.
However, good representations can be learned without any task-specific information from raw data.
In self-supervised learning, labels are generated art...
Good representations are expressive and make efficient use of the given dimensionality.
We want the representations to be variant to contextual changes that are essential to a task and invariant to changes related to factors that we cannot control nor care about.
While these inv...
❤️ Brainstash Inc.