Sharing and exchanging data is a critical element of any organization’s analytics strategy. In fact, BigQuery customers already share data using our existing infrastructure, with over 4,500 customers swapping data across organizational boundaries. Creating seamless access to analytics workflows and insights has become that much easier with the introduction of Analytics Hub and surfacing datasets unique to Google.
Last summer, the Google Trends public dataset was launched to democratize access to Google first-party data and drive additional value to our customers. At no additional cost, you can access Top 25 stories and Top 25 Rising search queries in the United States through a SQL-interface, unlocking countless new opportunities to derive insights from blending Google Trends datasets with other structured data sources. Since launching in June of 2021, over 30 terabytes of the Google Trends dataset have been queried by users across the United States.
From joining the Search Trends data to Nielsen Designated Market Area (DMA) boundaries to know where to activate marketing campaigns, to creating term forecasts and predictions to hypothesize and experiment product development, there are a broad range of applications across many business and consumer profiles. Through the secure and streamlined access to this highly desirable data in BigQuery, business and consumers alike are finally able to make better data-driven decisions at scale.
With the success of the Google Trends dataset launch in the United States, we knew that meeting the needs of our global counterparts would be a fast follow. After all, we are citizens of a global economy and must do better to accommodate the world we operate in. As such, we began our journey to provide a more comprehensive view of how trends occur across the globe for our customers.
Today, we are excited to announce the expansion of the Google Trends public dataset beyond the US to cover approximately 50 additional countries worldwide. This is available in public preview and covers all major countries where the Google Trends service exists today. Most of the features of the international Google Trends dataset will mimic its United States counterpart, backed by the same privacy-first mindset.
The international dataset will remain anonymized, indexed, normalized, and aggregated prior to publication. New sets of top terms and top rising queries will continue to be generated daily, with data being inserted into a new partition of their respective table. The expiration date of each top term and top rising set (e.g. each set’s partition) will also stay at 30 days. Every term within a set will still be enriched with a historical backfill over a rolling five year period. Learn more about the schema of each table in the dataset listing.
In addition to surfacing the top trends in the United States by Designated Market Area (DMA), the international dataset will provide the daily top stories and top rising queries by ISO country and sub-region. Countries and/or sub-regions may be excluded based on data-sharing regulation and policies. The sheer scale of coverage and reach now increases multi-fold by simply applying similar or existing use cases to different parts of the globe.
Working with the international Google Trends dataset
Just like all other Google Cloud datasets, users can obtain access without charges of up to 1TB/month in queries and up to 10GB/month in storage through BigQuery’s free tier and leverage the BigQuery sandbox, all subject to BigQuery’s free tier thresholds.
To begin exploring the global Google Trends dataset, simply query the international tables for the top 25 and top 25 rising terms from the Google Cloud Console. To minimize the data scanned and processed, utilize the partition filter, as well as country and region filters (if possible) in your query:
refresh_date = DATE_SUB(CURRENT_DATE(), INTERVAL 1 DAY)
AND country_code = 'CA'
AND region_name = 'Alberta'
What’s next for Google Cloud Datasets?
We are continuing to progress forward in the path to making Google’s first-party data universally accessible. Stay tuned for updates on more dataset launches and availability, as well as our integration with Analytics Hub. In the meantime, explore the new international Google Trends dataset in your own project, or if you’re new to BigQuery spin up a project using the BigQuery sandbox.
By: Maggy Hu (Product Manager) and Antonio Lobato (Software Engineering Manager)
Source: Google Cloud Blog