Google Top Stories Are Chosen By Importance Scores

Sharing is caring!

Changes have been made to Top Stories shown in Carousels in Google SERPs

Google made a recent announcement on its Keyword blog about top stories from non-news sites in search results. They told us about this change in the post Smarter organization of top stories in Search.

They start off the post by telling us:

People come to Search for all types of information to help them form a better understanding of the world and the topics they care about most. We’ve continued to bring new improvements to Search to help people better orient themselves around a topic and easily explore related ideas, so they can more quickly go from having a question in mind to developing deeper understanding. Now, we’re using the latest in machine learning to bring this approach to top stories in Google Search, making it easier for people to dive into the most useful, timely articles available.

They also tell us that we will see these top stories in carousels in organic search results when there are relevant and timely stories to share on a topic. Here is an example of the carousels about “top stories” involving artificial intelligence:

Artificial Intelligence Top Stories

On hearing this news, I did what I normally do when hearing about a change at Google. I went search through Google’s patents to see if I could find a recent patent that might be related in some way. I searched for “top stories” in Google patents and came across one that was granted in March of last year.

It didn’t have all of the added features that the blog post did, but it talks about how Google might start creating news digests filled with “top stories.” What the blog post told us was an added wrinkle to this reporting of the news was the addition of machine learning approaches using tools like BERT:

To generate these groups, we use a variety of machine learning techniques including BERT models to examine the related articles and determine where one story ends and another begins. Our research has shown that clustering results into clearly-defined stories are critical in helping people easily navigate the results and identify the best content for their needs.

In addition to the added use of machine learning, we were also told about these results being more well-rounded and diverse:

We’re now also featuring key information, such as notable quotes and related opinion pieces, in the top stories carousel within Search. These different content types provide people a more well-rounded view of a news story to help them decide which angle to explore more deeply.

Google News Digest Patent

This patent granted in March of 2019 gives us a look at the framework behind the surfacing of these “top stories” results in what Google refers to as an “automated news digest.”

When Google indexes news information from news sources the content providers of that information focus upon serving news articles for the current time, to “allow a user to view the most shared news articles or news stories.”

So what does this new patent do to bring something new and different to show off news results?

We are told that what is innovative in the patent is how it captures the most interesting stories from different times based upon the use of an “importance score” for that time period.

Top news stories are selected and the second top news stories use those importance scores to rank what is shown as “top stories.”

Articles associated with the top news stories for those times are selected and displayed – a predetermined number of articles about each story may be decided upon beforehand, and the stories that are shown may also depend upon categories of interest identified in a user profile for a searcher who may be looking at those (not mentioned in the patent, but this reminds me of Google Discovery, and Google collecting categories of interest when deciding what to show for a searcher, brings me thoughts of the post How Google Might Predict Query Intent Using Contextual Histories.)

Importance Scores for News Stories in the Automated News Digest

So how do “top stories” become “top stories?”

The news digest system, during a time, may rank each of the news stories from the snapshots of times/regions/languages. For instance, the news digest system determines a score for each of the news stories that represent the news story’s importance. The news digest system may use an importance score of each of the news stories to determine the score.

Each snapshot in the database includes data that represents a region, a language, or both.

The news story ranking process may decide that the news stories A-B for snapshot A are specific to a region M and a language N, such as North America or the United States, and English.

The news story ranking process determines another snapshot for a different region, such as the United Kingdom, or another language, such as French or Spanish.

News stories snapshots

Importance Scores for Top Stories

The importance score for a particular news story may be included in the same snapshot that identifies the particular news story. These are the things considered in the creation of such importance scores:

  • A number of articles written about a news story (when each news story relates to a general event such as snow in Washington, D.C. and the separate articles were published by different news distributors)
  • A cumulative number of clicks on articles about a news story
  • A cumulative number of social actions (shares, likes, etc.)
  • A cumulative number of queries received from user devices for which articles for a news story are responsive, are selected, or both
  • A rate of change of a metric for a news story (when the metric may be clicks, queries, social actions)
  • A time, recency or freshness of publication related to a news story
  • An expertise of a publisher in a certain news topic or geographic area (when the publisher published an article related to the news story)
  • A historical click rate on articles from the publisher
  • Citations made to the article and/or publisher
  • Relevance of article to the news story
  • Another appropriate metric
  • A combination of two or more of these to determine the score for the news story

The news digest system may use any number of relevant signals to determine a score and corresponding ranking of the news stories.

The importance scores are used to rank new stories like this:

The news digest system uses the scores to rank the news stories. For instance, the news digest system may determine that a news story A for the digest time period, e.g., Jan. 30, 2016, has a lower score than the news stories B through H 108b-h as indicated by the news story A not being presented in the news story ranking

Importance Scores for news stories flowchar

Advantages of this Automated News Digest Patent

A news digest system may:

  • Provide a user with more unbiased news May require little or no editorial judgment compared to systems that have an editorial review of news stories
  • Provide news digests irrespective of the digest time period, the region for the news digest, the language for the news digest, or a combination of two or more of these
  • Personalize a news digest according to user settings, e.g., personal interests of a user
  • Provide a news digest to a user device for a time period during which a user was unable to check the news
  • Provide a news digest to a user device that includes top stories for a historical time period, e.g., ten years ago
  • Provide a news digest to a user device that includes top stories for a particular topic of interest, e.g., when the particular topic of interest does not have frequent news stories

The Automated News Digest patent can be found at:

Automated news digest
Inventors: Pan Gu, Mayuresh Saoji, Yuqiang Guan, Maricia Scott, Vikas Sukla, and Anand Devraj Paka
Assignee: Google LLC
US Patent: 10,242,096
Granted: March 26, 2019
Filed: March 15, 2016


Methods, systems, and apparatus, including computer programs encoded on computer storage media, for automatic generation of news digests. One of the methods includes accessing a database storing news snapshots, each snapshot identifying a predetermined quantity of top news stories for a period of time, each of the top news stories in a particular snapshot for a particular period of time ranked according to an importance score that measures the importance of the news story relative to other news stories for the particular period of time, determining a digest time period, determining, for the digest time period, all of the snapshots with periods of time included in the digest time period, generating, from the top news stories in the determined snapshots, a digest ranking of digest news stories, and providing, to a user device, data identifying one or more of the digest news stories for presentation according to the digest ranking.


The Google blog post told us a few things that weren’t mentioned in the Automated News Digest Patent.

One is that for articles to appear in a “top stories” carousel, they do not need to be registered as news sites with Google. So timely blog posts and articles aren’t at news sites, but cover one of the news stories for a specific time could be included in the carousels.

The blog post also told us that Google will include in those carousels notable quotes and related opinion pieces. The purpose of those is to make sure that the news being shown is more detailed and diverse.

The importance score approach for particular news stories explains how certain stories are selected as top news, but not how the articles chosen for carousel slots are selected.

Sharing is caring!