Posts in tag

Python

DevOpsEngineering

We’re excited to announce the release of a major update to the Google Cloud Python logging library. v3.0.0 makes it even easier for Python developers to send and read logs from Google Cloud, providing real-time insights into what is happening in your application.  If you’re a Python developer working with Google Cloud, now is a …

Read More
DataDesignProgrammingTech

We are in the modern world where the digitization of much of education is already well underway. Nowadays, lots of blogs and articles are on the internet, for free, to learn from. But The Book has its own value: the author puts his all knowledge experience and time to write one whole book. The knowledge …

Read More
EngineeringSoftware Engineering

This article is the final in the three part series to explore the performance debugging ecosystem of PyTorch/XLA on Google Cloud TPU VM. In the first part, we introduced the key concept to reason about the training performance using PyTorch/XLA profiler and ended with an interesting performance bottleneck we encountered in the Multi-Head-Attention (MHA) implementation …

Read More
DataEngineeringSoftware EngineeringTechnology

This article is part-II of the series on ‘PyTorch/XLA:Performance Debugging on TPU-VM’. In the previous article we introduced the basic metrics of performance analysis. We used the client side debugging with the PyTorch/XLA profiler to identify how the .equal() operator used inside the Multihead Attention module implementation caused frequent recompilation of the graph causing  the …

Read More
ProgrammingSoftware EngineeringTechTools

In this three part series we explore the performance debugging ecosystem of PyTorch/XLA on Google Cloud TPU VM. TPU VM earlier this year (2021). The TPU VM architecture allows the ML practitioners to work directly on the host where TPU hardware is attached. With the TPU profiler launched earlier this year, debugging your PyTorch training …

Read More
DataProgramming

In this tutorial, you’ll be introduced to 6 handy Python data visualization libraries, and learn how to choose among them. Data visualization is a great way to analyze and present information; Python is one of the most popular data analysis languages. This results in many good Python libraries for data visualizations. There is no single best …

Read More
DataEngineeringPractices

We’re very excited to announce the general availability of the Google Cloud Spanner dialect that enables SQLAlchemy applications to take advantage of Cloud Spanner‘s scale, strong consistency, and up to 99.999% availability. SQLAlchemy is a Python SQL toolkit and Object Relational Mapper, giving application developers the full power and flexibility of SQL. Its object-relational mapper …

Read More
DataEngineeringProgrammingSoftwareTechnology

SlashData’s latest Developer Nation report looks at the popularity of programming languages and trends from the global developer community.  JavaScript is now used by more than 16.4 million developers globally, says a survey of more than 19,000 coders – making it the world’s most popular programming language “by a wide margin”. SlashData’s 21st State of the …

Read More
DataEngineeringPracticesProgrammingTechnology

Techniques on what to clean and how. Before fitting a machine learning or statistical model, we always have to clean the data. No models create meaningful results with messy data. Data cleaning or cleansing is the process of detecting and correcting (or removing) corrupt or inaccurate records from a record set, table, or database and refers to identifying incomplete, incorrect, …

Read More
Software EngineeringSolutionsTechnology

Editor’s note: Over the past several weeks, we’ve posted a series of blog posts focusing on best practices for writing Google Cloud Functions based on common questions or misconceptions as seen by the Support team.  We refer to these as “anti-patterns” and offer you ways to avoid them.  This article is the fifth post in …

Read More