Twitter's Recommendation Algorithm - Deepstash
Twitter's Recommendation Algorithm

Twitter's Recommendation Algorithm

Curated from: blog.twitter.com

Ideas, facts & insights covering these topics:

4 ideas

·

230 reads

6

Explore the World's Best Ideas

Join today and uncover 100+ curated journeys from 50+ topics. Unlock access to our mobile app with extensive features.

Recommendation algorithm

Recommendation algorithm

The recommendation pipeline has four steps:

  1. Candidate sourcing - Fetch the best tweets from different recommendation sources
  2. Ranking - Rank tweets such that the most relevant ones appear first in the feed.
  3. Filtering - Apply heuristics and filters to create a balanced and diverse feed.
  4. Mixing non-tweet content like Ads, Follow Recommendations, and Onboarding prompts.

The recommendation pipeline runs 5 billion times per day and completes in under 1.5 seconds on average.

6

85 reads

Candidate sourcing

Gets the best 1,500 recent tweets:

  • 50% from people you follow (In-Network)
  • 50% from people you don't follow (Out-of-Network)

In-Network

  • Uses a logistic regression model to rank the recent tweets of people you follow. The higher the likelihood of engagement between you and another user, the more of their tweets will be included.

Out-of-network

  • Uses a social graph of engagements to find tweets that people you follow have recently engaged with, and tweets liked by people who are similar to you.
  • Uses an embedding space of users and tweets to determine what tweets and users are similar to your interests.

6

58 reads

Ranking

Ranking is achieved with a 48M parameter neural network that is continuously trained on tweet interactions to optimize for positive engagement (e.g. Likes, Retweets, and Replies). This ranking mechanism takes into account thousands of features and outputs ten labels to give each tweet a score, where each label represents the probability of an engagement.

6

51 reads

Apply heuristics and filters

  • Visibility Filtering: Remove tweets from accounts you block or mute. 
  • Author Diversity: Avoid too many consecutive tweets from a single author.
  • Content Balance: Deliver a fair balance of In-Network and Out-of-Network tweets.
  • Feedback-based Fatigue: Lower the score of tweets that you provided negative feedback around.
  • Social Proof: Exclude Out-of-Network tweets without a second degree connection to the tweet i.e. ensure someone you follow engaged with the tweet or follows the tweet’s author.
  • Conversations: Provide more context to a Reply by threading it together with the original tweet.

6

36 reads

IDEAS CURATED BY

ocpodariu

Alt account of @ocp. I use it to stash ideas about software engineering

Ovidiu Podariu (Tech)'s ideas are part of this journey:

Metaverse

Learn more about computerscience with this collection

Find out the challenges it poses

Learn about the potential impact on society

Understanding the concept of Metaverse

Related collections

Read & Learn

20x Faster

without
deepstash

with
deepstash

with

deepstash

Personalized microlearning

100+ Learning Journeys

Access to 200,000+ ideas

Access to the mobile app

Unlimited idea saving

Unlimited history

Unlimited listening to ideas

Downloading & offline access

Supercharge your mind with one idea per day

Enter your email and spend 1 minute every day to learn something new.

Email

I agree to receive email updates