Posts by tag

Data Processing

2 posts
View Post
  • 7 min

The Benefits And Core Processes Of Data Wrangling

Data wrangling, also known as data munging, is the process of cleaning, transforming, and organizing raw data for further analysis and integration. In this article, I will explore the significance and benefits of data wrangling, the process of making raw data usable for different end users, and the application of data wrangling in AI and machine learning. Let’s start by taking a closer look at data wrangling and its significance in finance. With a predicted market size of 103B in 2027 according to Statista, unlocking big data’s full potential is more relevant than ever. As big data continues to evolve, companies…
View Post
Share
View Post
  • 3 min

Automate Annotations For Vertex AI Text Datasets With Cloud Vision API And BigQuery

One of the main challenges machine learning practitioners face is the availability of annotated training datasets or a lack thereof. In many cases, practitioners may have access to existing datasets that have been manually extracted, which they can use to accelerate their model training. In this post, we demonstrate how Google Cloud AI/ML products can be used to train a text entity extraction model for patent application PDFs. We use BigQuery, Vision API, and Jupyter Notebook to automatically annotate an existing dataset used for model training. Although we won’t go into the details of each step, you can check the…
View Post
Share