What sites are included in the Global Index?

Diffbot’s Global Index for News is constantly crawling tens of thousands of news and blog sites from around the world, structuring all content into a comprehensive news database.

We do not provide a complete list of sources as we are continually updating and adjusting the sites we crawl. If you’d like to confirm the presence of certain sites please contact us (or perform a site:domain.com search to see all indexed content from the site in question).

Wherever possible, we are happy to include additional relevant news sources that are not currently in the crawling pool. If sources are not determined to be broadly applicable, we will let you know and can assist you in creating distinct Crawlbot crawls to monitor these additional sites.