Posts in category

Design


Financial markets were among the first to adopt new technologies, and that has certainly been true of the derivatives markets, which were early adopters of electronic trading. Going forward, new capabilities will transform the way industry participants communicate, analyze, and trade. I sat down with Google Cloud’s Phil Moyer and former SEC Commissioner, Troy Paredes, …

Bringing AI models to a production environment is one of the biggest challenges of AI practitioners. Much of the discussions in the AI/ML space revolve around model development. As shown in this diagram from the canonical Google paper “Hidden Technical Debt in Machine Learning Systems”, the bulk of activities, time and expense in building and …

Cloud Spanner is a fully managed relational database that offers near unlimited scale, strong consistency, and industry leading high availability of up to 99.999%. Spanner powers applications of all sizes in multiple industries including financial services, gaming, retail, and healthcare. Spanner provides great value and price-performance since it helps you save operational costs, provides multiple …

Game developers often reuse their existing database platform to launch their new games or launch new features to their existing games. This requires the database to scale in terms of new schema (tables, index, etc.), data and traffic. For games built with Cloud Spanner databases, most database operations can be done seamlessly, without affecting production …

PostgreSQL uses transaction IDs (TXIDs, XIDs) to implement Multi-Version Concurrency Control semantics (MVCC). The PostgreSQL documentation explains the role of TXIDs as follows: PostgreSQL’s MVCC transaction semantics depend on being able to compare transaction ID (XID) numbers: a row version with an insertion XID greater than the current transaction’s XID is “in the future” and …

When a deployed ML model produces poor predictions, it can be due to a wide range of problems. It can be the result of bugs that are typical in any program—but it can also be the result of ML-specific problems. Perhaps data skews and anomalies are causing model performance to degrade over time. Or the …

Apache Tomcat is one of the most commonly used web servers and servlet containers for running Java applications. Many enterprises run production Java web applications on Tomcat servers, running on virtual machines and are looking to modernize those applications to run in containers and enjoy the benefits of containerized, cloud native environments such as Cloud Run or Google Kubernetes …

API gateways are a critical component of a modern architecture. Apigee X is Google Cloud’s API management platform. It also allows users of the legacy Apigee Edge product to leverage Virtual Private Cloud (VPC) products and features, like Cloud Armor and Load Balancers. With these new security and availability advantages come a new set of …

You have a cloud use case… How do you go from idea to implementation? The first step in your implementation journey is the architecture diagram. Having an architecture diagram is critical because it enables you to share the vision with the team, collaborate with them, iterate on the design, and create the final version that …

Previously in the PyTorch on Google Cloud series, we trained, tuned and deployed a PyTorch text classification model using Training and Prediction services on Vertex AI. In this post, we will show how to automate and monitor a PyTorch based ML workflow by orchestrating the pipeline in a serverless manner using Vertex AI Pipelines. Let’s …