Data Analytics

New Observability Features For Your Splunk Dataflow Streaming Pipelines
We’re thrilled to announce several new observability features for the Pub/Sub to Splunk Dataflow template to help operators keep a tab on their streaming pipeline performance. Splunk Enterprise and Splunk Cloud customers use the Splunk Dataflow template to reliably export Google Cloud logs for in-depth analytics for security, IT or business use cases. With newly …

Extending BigQuery Functions Beyond SQL With Remote Functions, Now In Preview
Today we are announcing the Preview of BigQuery Remote Functions. Remote Functions are user-defined functions (UDF) that let you extend BigQuery SQL with your own custom code, written and hosted in Cloud Functions, Google Cloud’s scalable pay-as-you-go functions as a service. A remote UDF accepts columns from BigQuery as input, performs actions on that input …

Now Generally Available: BigQuery BI Engine Supports Any BI Tool Or Custom Application
Customers who work with data warehouses, running BI on large datasets used to have to pick low latency but trading off freshness of data. With BigQuery BI Engine, they can accelerate their dashboards and reports that connect to BigQuery without having to sacrifice freshness of the data. Using the latest insights helps them make better …

Solving For Food Waste With Data Analytics In Google Cloud
With over ⅓ of the food in the USA ending up as waste according to the USDA, it is a compelling challenge to address this travesty. What will happen to hunger, food prices, trash reduction, water consumption, and overall sustainability when we stop squandering this abundance? Beginning with the departure from the farm …

Mosquitoes Get The Swat With New Mosquito Forecast Built By OFF! Insect Repellents And Google Cloud
Mosquitoes aren’t just the peskiest creatures on Earth; they infect more than 700 million people a year with dangerous diseases like Zika, Malaria, Dengue Fever, and Yellow Fever. Prevention is the best protection, and stopping mosquito bites before they happen is a critical step. SC Johnson—a leading developer and manufacturer of pest control products, consumer …

Orchestrate Looker Data Transformations With Cloud Composer
We are announcing that Looker’s new Google Cloud operators for Apache Airflow are available in Cloud Composer, Google Cloud’s fully managed service for orchestrating workflows across cloud, hybrid, and multi-cloud environments. This integration gives users the ability to orchestrate Looker persistent derived tables (PDTs) alongside the rest of their data pipeline. Looker PDTs are the …

Data Movement For The Masses With Dataflow Templates
It’s 4 PM on a Friday afternoon, and your mind has already checked out for the weekend. Just as you are about to close your laptop, you see an e-mail come in from your engineering manager. You dread what lies ahead. “Our data science team needs to analyze streaming data from our Kafka cluster. They …

Top 5 Takeaways From Data Cloud Summit ‘22
To compete in a fast moving, transforming, and increasingly digital world, every team, business, process and individual needs to level up the way they think about data. Which is why this year at our Data Cloud Summit 2022, we saw record turnout, both in volume and diversity of attendance. Our thanks go out to all …

Now In Preview, BigQuery Search Features Provide A Simple Way To Pinpoint Unique Elements In Data Of Any Size
We are excited to announce the public preview of search indexes and related SQL SEARCH functions in BigQuery. This is a new capability in BigQuery that allows you to use standard BigQuery SQL to easily find unique data elements buried in unstructured text and semi-structured JSON, without having to know the table schemas in advance. …

Introducing Serverless Spark For Interactive Development
At Google Cloud, we’re committed to helping you build an open and integrated data platform that meets your specific business needs. We believe in order to build the world you want, you need to be able to use the tools you want, on a powerful and unified platform. To that end, we’re making Apache Spark …