aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
  • Engineering
  • Practices

Cloud Storage Gets Better System Observability With Customizable Monitoring Dashboards

  • aster.cloud
  • December 16, 2022
  • 5 minute read

Google Cloud Storage is a managed service for storing unstructured data and allowing retrieval of the data as often as users like. Because Cloud Storage is a fundamental and highly utilized service, the observability of storage is critical for storage engineers’ and administrators’ day-to-day operations. It is also critical for the scalability and sustainability of a business.

When it comes to the observability of storage, we hear Cloud Storage users asking us these questions:


Partner with aster.cloud
for your next big idea.
Let us know here.



From our partners:

CITI.IO :: Business. Institutions. Society. Global Political Economy.
CYBERPOGO.COM :: For the Arts, Sciences, and Technology.
DADAHACKS.COM :: Parenting For The Rest Of Us.
ZEDISTA.COM :: Entertainment. Sports. Culture. Escape.
TAKUMAKU.COM :: For The Hearth And Home.
ASTER.CLOUD :: From The Cloud And Beyond.
LIWAIWAI.COM :: Intelligence, Inside and Outside.
GLOBALCLOUDPLATFORMS.COM :: For The World's Computing Needs.
FIREGULAMAN.COM :: For The Fire In The Belly Of The Coder.
ASTERCASTER.COM :: Supra Astra. Beyond The Stars.
BARTDAY.COM :: Prosperity For Everyone.

  1. What’s the best practice to get me started with observing my storage projects and buckets?
  2. What’s the most important operational metrics/logs I should be monitoring to proactively identify issues and troubleshoot?
  3. What if I want to create alerts for the storage metrics I care about? How can I do that? Can I see my alerts inside the storage project or for the buckets?

Users also comment that they have to hop between different observability tools, which causes them to frequently lose context when navigating between multiple monitoring platforms.

Today, we are excited to announce the public preview of a new set of Cloud Storage Monitoring Dashboards for Cloud Storage, which are available at both the project level and bucket level.

All Cloud Storage users can now access the new dashboards through the Monitoring tab on the left navigation menu.

 

Highly customizable for your needs

We know that there is no one-size-fits-all observability that could satisfy all users’ needs. So we made these dashboards customizable in-context, allowing you to create your own dashboard version and set it as the default view. If you have monitoring editor or owner access or project editor or owner access, you can add an alert chart from a previously created alert policy, or you can create an alert by customizing the out-of-the-box dashboard. You are able to see the alerts directly in-context on the Cloud Storage Monitoring page if you added the alert chart in a customized dashboard. You can also add metrics from different services on the dashboards to observe correlations without leaving the storage pages of the Google Cloud console.

Read More  Working With Azure’s Data API Builder

In the logs panel, you can edit the log viewer query to reflect the most important logs you care about and persist that query in the storage project customized dashboard. Ability to browse metrics and logs on the same dashboard reduces context switching and enables more effective troubleshooting.

The customizable dashboard enables you to perform the troubleshooting journey inside the storage pages on the platform, reducing the need to navigate between different monitoring tools, or even different monitoring platforms.

Operational metrics out-of-the-box

There are many aspects of storage observability, and the new monitoring dashboards are focused on troubleshooting. These include out-of-the-box storage system metrics and storage system logs that every storage user automatically receives when initiating the storage service on Google Cloud.

You can hover over the chart and read the values or expand the legend, zoom in or zoom out the time range to see more granular or coarse data, and use advanced queries such as MQL or PromQL in the Cloud Monitoring UI. In fact, you have the ability to use the full functionality of Cloud Monitoring dashboarding inside storage pages on the Google Cloud console.

Here are some more details on the charts and the log panels available on these dashboards.

Charts

Server Error Rate of Storage API Request Count: filtered to display all server side 5xx errors

Client Error Rate of Storage API Request Count: filtered to display all client side 4xx errors including their response codes

Top 5 Buckets with Most Read Errors: filtered to List and Read methods, and the response code is filtered to the INTERNAL and UNAVAILABLE errors, as measured from the top 5 buckets. You can easily customize the chart to display more buckets with these errors.

Read More  Google Public Sector Announces Continuity-Of-Operations Offering For Government Entities Under Cyberattack

Top 5 Buckets with Most Write Errors: similar to the most read errors, this chart is filtered to the WriteObject method when the response code is INTERNAL and UNAVAILABLE errors.

Total Read/List/Get Request Count: filtered by the API request count with the Read, List and Get methods. You should expect to see the total number of requests for these three methods in a given time and see the total counts broken down by the location of the API method.

Total Write Request Count: filtered by the Write method from all the API requests and shows you the total number of write requests, also broken down by the location.

Data Ingress Rate over the Network: shows the rate of received bytes so you can easily understand the rate of ingress per project or per bucket.

  • This chart can be customized to show total volume of received bytes for project
  • At the bucket-level dashboard, this chart is filtered to show the per bucket ingress rate in the project

Data Egress Rate over the Network: shows the rate of sent bytes so you can easily understand the rate of egress per project or per bucket.

Log Panels

GCS Logs and Audit logs Widgets

  • The two logs widgets are filtered to GCS logs and GCS Audit logs with a severity equal to or greater than Error. Logs with severity of Error, Critical, Alert, and Emergency will be displayed in the logs panel.
  • You can expand on the logs entry in the widget and can easily navigate to the logs explorer view by clicking on View in logs Explorer Button.
Read More  How AI Can Improve Digital Security

At the bucket level, we also provide all the charts that are available on the project level, and we filter these dashboards to the specific bucket. Once the customization of a bucket level dashboard is created, the customized bucket level dashboard will automatically be visible to all the bucket level dashboards within the project. You can simply navigate to a different bucket and select from the drop down menu to view the customized dashboard.

 

https://storage.googleapis.com/gweb-cloudblog-publish/original_images/GCS_bucket_level_dashboard.gif

Get started today with the preview

You can get started with the preview today by clicking the Monitoring tab on the left navigation menu of the Cloud Storage UI. It is available to all Cloud Storage users.

We are very excited to see these dashboards become publicly available to all of our users and we look forward to hearing from you for suggestions and feedback.

On each of the dashboards, you can submit the feedback using the “Send Feedback” button. We will carefully read each of your suggestions and will make continuous improvements to the dashboard to help all users analyze their daily operations within Cloud Storage.

 

By: Joy Wang (Product Manager) and Subodh Bhargava (Product Manager)
Source: Google Cloud Blog


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Our humans need coffee too! Your support is highly appreciated, thank you!

aster.cloud

Related Topics
  • Cloud Storage
  • Google Cloud
  • Infrastructure
  • Monitoring
You May Also Like
View Post
  • Engineering

Just make it scale: An Aurora DSQL story

  • May 29, 2025
View Post
  • Engineering
  • Technology

Guide: Our top four AI Hypercomputer use cases, reference architectures and tutorials

  • March 9, 2025
View Post
  • Computing
  • Engineering

Why a decades old architecture decision is impeding the power of AI computing

  • February 19, 2025
View Post
  • Engineering
  • Software Engineering

This Month in Julia World

  • January 17, 2025
View Post
  • Engineering
  • Software Engineering

Google Summer of Code 2025 is here!

  • January 17, 2025
View Post
  • Data
  • Engineering

Hiding in Plain Site: Attackers Sneaking Malware into Images on Websites

  • January 16, 2025
View Post
  • Computing
  • Design
  • Engineering
  • Technology

Here’s why it’s important to build long-term cryptographic resilience

  • December 24, 2024
IBM and Ferrari Premium Partner
View Post
  • Data
  • Engineering

IBM Selected as Official Fan Engagement and Data Analytics Partner for Scuderia Ferrari HP

  • November 7, 2024

Stay Connected!
LATEST
  • 1
    Just make it scale: An Aurora DSQL story
    • May 29, 2025
  • 2
    Reliance on US tech providers is making IT leaders skittish
    • May 28, 2025
  • Examine the 4 types of edge computing, with examples
    • May 28, 2025
  • AI and private cloud: 2 lessons from Dell Tech World 2025
    • May 28, 2025
  • 5
    TD Synnex named as UK distributor for Cohesity
    • May 28, 2025
  • Weigh these 6 enterprise advantages of storage as a service
    • May 28, 2025
  • 7
    Broadcom’s ‘harsh’ VMware contracts are costing customers up to 1,500% more
    • May 28, 2025
  • 8
    Pulsant targets partner diversity with new IaaS solution
    • May 23, 2025
  • 9
    Growing AI workloads are causing hybrid cloud headaches
    • May 23, 2025
  • Gemma 3n 10
    Announcing Gemma 3n preview: powerful, efficient, mobile-first AI
    • May 22, 2025
about
Hello World!

We are aster.cloud. We’re created by programmers for programmers.

Our site aims to provide guides, programming tips, reviews, and interesting materials for tech people and those who want to learn in general.

We would like to hear from you.

If you have any feedback, enquiries, or sponsorship request, kindly reach out to us at:

[email protected]
Most Popular
  • Understand how Windows Server 2025 PAYG licensing works
    • May 20, 2025
  • By the numbers: How upskilling fills the IT skills gap
    • May 21, 2025
  • 3
    Cloud adoption isn’t all it’s cut out to be as enterprises report growing dissatisfaction
    • May 15, 2025
  • 4
    Hybrid cloud is complicated – Red Hat’s new AI assistant wants to solve that
    • May 20, 2025
  • 5
    Google is getting serious on cloud sovereignty
    • May 22, 2025
  • /
  • Technology
  • Tools
  • About
  • Contact Us

Input your search keywords and press Enter.