Twitter's Recommendation Algorithm - Deepstash
Metaverse

Learn more about computerscience with this collection

Find out the challenges it poses

Learn about the potential impact on society

Understanding the concept of Metaverse

Metaverse

Discover 76 similar ideas in

It takes just

11 mins to read

Recommendation algorithm

Recommendation algorithm

The recommendation pipeline has four steps:

  1. Candidate sourcing - Fetch the best tweets from different recommendation sources
  2. Ranking - Rank tweets such that the most relevant ones appear first in the feed.
  3. Filtering - Apply heuristics and filters to create a balanced and diverse feed.
  4. Mixing non-tweet content like Ads, Follow Recommendations, and Onboarding prompts.

The recommendation pipeline runs 5 billion times per day and completes in under 1.5 seconds on average.

6

79 reads

Candidate sourcing

Gets the best 1,500 recent tweets:

  • 50% from people you follow (In-Network)
  • 50% from people you don't follow (Out-of-Network)

In-Network

  • Uses a logistic regression model to rank the recent tweets of people you follow. The higher the likelihood of engagement between you and another user, the more of their tweets will be included.

Out-of-network

  • Uses a social graph of engagements to find tweets that people you follow have recently engaged with, and tweets liked by people who are similar to you.
  • Uses an embedding space of users and tweets to determine what tweets and users are similar to your interests.

6

54 reads

Ranking

Ranking is achieved with a 48M parameter neural network that is continuously trained on tweet interactions to optimize for positive engagement (e.g. Likes, Retweets, and Replies). This ranking mechanism takes into account thousands of features and outputs ten labels to give each tweet a score, where each label represents the probability of an engagement.

6

46 reads

Apply heuristics and filters

  • Visibility Filtering: Remove tweets from accounts you block or mute. 
  • Author Diversity: Avoid too many consecutive tweets from a single author.
  • Content Balance: Deliver a fair balance of In-Network and Out-of-Network tweets.
  • Feedback-based Fatigue: Lower the score of tweets that you provided negative feedback around.
  • Social Proof: Exclude Out-of-Network tweets without a second degree connection to the tweet i.e. ensure someone you follow engaged with the tweet or follows the tweet’s author.
  • Coďťżnversations: Provide more context to a Reply by threading it together with the original tweet.

6

34 reads

CURATED BY

ocpodariu

Alt account of @ocp. I use it to stash ideas about software engineering

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Access to 200,000+ ideas

—

Access to the mobile app

—

Unlimited idea saving & library

—

—

Unlimited history

—

—

Unlimited listening to ideas

—

—

Downloading & offline access

—

—

Personalized recommendations

—

—

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates