Rating Categories

Our Podcast Reliability Ratings assess how much risk each podcast poses in terms of misinformation or unreliable news.

Based on NewsGuard’s judgment with regard to whether the podcast generally adheres to each of the criteria, a podcast receives a score from 0-10. That score determines in which risk category the podcast falls. Here are NewsGuard’s four score bands:

Lowest risk (10 pts) / Low risk (8-9 pts)

Some risk (6-7 pts)

High risk (0-5 pts)

Note: NewsGuard reviews each podcast and its rating periodically to ensure it is up to date.

Rating Criteria

The journalists at NewsGuard assess news and information podcasts based on five journalistic criteria. Each criterion is worth a certain number of points, as indicated below, based on its importance. Criteria are evaluated on a pass/fail basis, meaning that a podcast either receives all of the points associated with a criterion or none of them.

The criteria and their definitions are listed below:

• Does not regularly convey false, unchallenged information: The podcast host does not repeatedly convey clearly false facts of significant importance and does not allow guests to repeatedly convey clearly false facts in a way that is not challenged by the host or other guests. This could include clearly false facts that are included in commentary to support an argument. (4 Points)
• Conveys news on important topics responsibly: This podcast rarely if ever conveys unchallenged false facts, presents unsubstantiated claims as fact, or distorts or misrepresents information regarding important issues. If drawing heavily on the work of others who have reported on news events, present or past, efforts are made to credit such prior reporting and to vet it for reliability, including not relying on unreliable sources or sources whose reliability cannot be ascertained. (3 Points)
• Is not dominated by one-sided opinion: The podcast does not overwhelmingly air one-sided commentary. (1 Points)
• Discloses, or does not have, a political agenda: The podcast does not advance a political agenda, or if the podcast is dominated by one-sided opinion, the podcast clearly discloses its point of view, political leaning, or political affiliations in a manner that is accessible to the average listener, such as within the podcast’s written description or in audio introducing the podcast. (1 Point)
• Differentiates advertising and commercial partnerships from editorial content: Advertisements and other content stemming from or related to a commercial partnership is presented in a way such that the average listener can distinguish sponsored content from editorial content. This can be done through direct statements introducing sponsored content, identifiable changes in background music or audio style, or otherwise apparent transitions. (1 Point)

Rating Process

The rating process is designed to ensure that NewsGuard’s five basic, apolitical journalistic criteria are applied equally and accurately to all podcasts, regardless of the podcast’s topic, tone, or political leaning, if any. Steps include:

1. An analyst assesses the contents of the podcast against five journalistic criteria. Our analysts are trained journalists who conduct reporting to determine relevant details of the podcast’s credibility and transparency practices.
2. The analyst drafts a “Nutrition Label” for the podcast based on this reporting. Nutrition Labels consist of a grid showing the podcast’s performance on each of the five criteria and a written explanation of the content on the podcast and why it received its rating.
3. If an analyst believes a podcast may fail one or more of the five criteria, the analyst contacts the podcast to attempt to seek comment before publishing the rating. If a representative for the podcast provides a comment, that comment is included in the written assessment of the podcast to provide users with the podcast’s perspective.
4. The rating is reviewed and fact-checked by experienced editors. Multiple senior editors review every podcast Nutrition Label prior to publication.
5. The podcast receives a red, yellow, or green rating based on the five journalistic criteria. The podcast’s red, yellow, or green rating is determined solely based on the five criteria.
6. In addition, if the podcast being rated is highly opinionated, that designation is included as a meta-data tag to be used by advertisers that seek to avoid highly opinionated programs.
7. Our team at least biannually updates its rating of each podcast. If a podcast changes its practices, its score on one or more of the five criteria may change.
8. We practice accountability and show our work. Each podcast’s Nutrition Label contains the names of the writer and editors who worked on the rating. The backgrounds of the analysts and editors named, as well as those of the supervising editors, can be found by clicking on their names or going to the Our Team page of this website. If a publisher disagrees with our rating for its podcast, it can write a response or complaint using our contact page. Any such complaints will be published on our website here and linked from the podcast’s Nutrition Label.

NewsGuard Podcast Ratings FAQs

How did NewsGuard develop its criteria to rate podcasts?

NewsGuard’s criteria were developed by NewsGuard’s team of experienced journalists and editors. They are based on longstanding, widely accepted journalistic standards of credibility and transparency.

The criteria were adapted from NewsGuard’s rating criteria for news websites, drawing on many of the same principles and applying them to an audio format. Broadly speaking, the criteria focus on whether a podcast conveys egregiously false information on important topics; whether it does so repeatedly or only occasionally; whether the podcast is dominated by one-sided opinion; whether it discloses its political agenda, if it has any; and whether the podcast differentiates advertising and commercial partnerships from editorial content.

What and how much content does NewsGuard review before rating a podcast?

NewsGuard’s analysts review a sampling of podcast episodes over a three-month period from the time of review. This ensures the rating is based on a review of the podcast’s recent practices.

Additionally, our analysts browse and search a repository of episodes and episode transcripts from the past 90 days. If necessary, they conduct searches on noteworthy topics such as COVID-19 and elections to understand how each podcast covered top news topics, especially topics about which key facts are disputed or which are the subject of significant debate. Our analysts also look for important moments in a podcast’s recent history, such as recent controversies, retractions, awards and accolades, and examine corresponding audio clips. Before quoting, transcripts are always confirmed against original audio clips to ensure accuracy.

How often does NewsGuard update its ratings and Labels?

As a matter of practice, NewsGuard aims to review and refresh its ratings for all podcasts every six months. However, more frequent updates will occur if circumstances warrant — such as a change in ownership, a change in practices, or if the podcast wins an award or becomes embroiled in a controversy.

Read our About, FAQ, and Why should anyone trust NewsGuard? pages for more information on us and our work.