aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
Storage Ceph
  • Cloud-Native
  • Data

The Growth Of IBM Storage Ceph – The Ideal Foundation For A Modern Data Lakehouse

  • Dean Marc
  • January 30, 2024
  • 5 minute read

It’s been one year since IBM integrated Red Hat storage product roadmaps and teams into IBM Storage. In that time, organizations have been faced with unprecedented data challenges to scale AI due to the rapid growth of data in more locations and formats, but with poorer quality. Helping clients combat this problem has meant modernizing their infrastructure with cutting-edge solutions as a part of their digital transformations. Largely, this involves delivering consistent application and data storage across on-premises and cloud environments. Also, crucially, this includes helping clients adopt cloud-native architectures to realize the benefits of public cloud like cost, speed, and elasticity. Formerly Red Hat Ceph – now IBM Storage Ceph – a state-of-the-art open-source software-defined storage platform, is a keystone in this effort.

IBM Storage Ceph

Software-defined storage (SDS) has emerged as a transformative force when it comes to data management, offering a host of advantages over traditional legacy storage arrays including extreme flexibility and scalability that are well-suited to handle modern uses cases like generative AI. With IBM Storage Ceph, storage resources are abstracted from the underlying hardware, allowing for dynamic allocation and efficient utilization of data storage. This flexibility not only simplifies management but also enhances agility in adapting to evolving business needs and scaling compute and capacity as new workloads are introduced. This self-healing and self-managing platform is designed to deliver unified file, block, and object storage services at scale on industry standard hardware. Unified storage helps provide clients a bridge from legacy applications running on independent file or block storage to a common platform that includes those and object storage in a single appliance.


Partner with aster.cloud
for your next big idea.
Let us know here.



From our partners:

CITI.IO :: Business. Institutions. Society. Global Political Economy.
CYBERPOGO.COM :: For the Arts, Sciences, and Technology.
DADAHACKS.COM :: Parenting For The Rest Of Us.
ZEDISTA.COM :: Entertainment. Sports. Culture. Escape.
TAKUMAKU.COM :: For The Hearth And Home.
ASTER.CLOUD :: From The Cloud And Beyond.
LIWAIWAI.COM :: Intelligence, Inside and Outside.
GLOBALCLOUDPLATFORMS.COM :: For The World's Computing Needs.
FIREGULAMAN.COM :: For The Fire In The Belly Of The Coder.
ASTERCASTER.COM :: Supra Astra. Beyond The Stars.
BARTDAY.COM :: Prosperity For Everyone.

Ceph is optimized for large single and multisite deployments and can efficiently scale to support hundreds of petabytes of data and tens of billions of objects, which is key for traditional and newer generative AI workloads. The scalability, resiliency, and security of IBM Storage Ceph make it ideal to support data lakehouse and AI/ML open-source frameworks, in addition to more traditional workloads such as MySQL and MongoDB on Red Hat OpenShift or RedHat OpenStack. It’s one reason why 768 TiB raw capacity of IBM Storage Ceph is included in watsonx.data, IBM’s open, governed, fit-for-purpose data lakehouse architecture optimized for data, analytics, and AI workloads. 

Read More  InfluxData Announces Availability Of The Leading Time Series Platform On Google Cloud

The Right-fit Foundation for Compute-Intensive and Data-Intensive Workloads

The explosive growth of unstructured data and generative AI share a symbiotic relationship, each influencing and benefiting the other. In its Top Trends in Enterprise Data Storage 2023 report, Gartner® states that “by 2028, large enterprises will triple their unstructured data capacity across their on premises, edge and public cloud locations, compared to mid-2023.” The proliferation of unstructured data, such as text, images, and videos, provides a vast and diverse source for training generative AI models. In turn, generative AI assists in making sense of and extracting valuable insights from the ever-expanding pool of unstructured data. This synergy results in a feedback loop where generative AI thrives on the abundance of unstructured data, and the continuous generation of realistic data by AI further enriches and refines your understanding of unstructured datasets, fostering innovation and advancements.

“By 2028, 70% of file and object data will be deployed on a consolidated unstructured data storage platform, up from 35% in early 2023,” according to the same Gartner® report. Organizations, therefore, need a storage management solution capable of accelerated data ingest, data cleansing and classification, metadata management and augmentation, and cloud-scale capacity management and deployment, such as software-defined storage. IBM Storage Ceph scales out seamlessly to meet these growing data demands. Its self-managing capabilities ensure that the system continuously adapts to constantly changing conditions, making the solution hassle-free while easily maintaining data integrity.

To accelerate and scale the impact of data and AI across an organization – and ultimately improve business outcomes – companies must be hybrid by design. This includes the ability to consume storage services on-prem with a cloud-native operating model to address issues such as the need for enterprise features sets unavailable on public cloud, data sovereignty considerations, and cost. The plug-and-play architecture of IBM Storage Ceph simplifies integration with existing infrastructures, including various platforms, cloud environments, hypervisors, open source data repositories like Apache Iceberg or Apache Parquet, and complete solution stacks such as watsonx.ai, watsonx.data, and others. New nodes or devices can be added to the cluster seamlessly, without having disruptions or service downtime. ​It delivers an easy and efficient way for clients to build a data lakehouse with watsonx.data and other next-generation AI workloads. 

At Snap, our requirement to store more and more data continues to expand, and we need a platform that can scale quickly, satisfy our performance KPIs, and be cost effective all at the same time. IBM Storage Ceph is the platform of choice with its simple scalable architecture, easy to manage interface, and cost-effective software-defined deployment. Having world-class expertise and support from IBM is another important part of our decision to use IBM Storage Ceph for such a critical component of our business. — Snap Inc

Fast Data Access with NVMe over TCP

Read More  Siemens, IBM, Red Hat Launch Hybrid Cloud Initiative To Increase Real-time Value Of Industrial IoT Data

In the last year, IBM has introduced several important updates to Ceph, including, most recently, IBM Storage Ceph 7.0. This next generation Ceph platform prepares for NVMe/TCP capabilities which are designed to enable faster data transfer between storage devices, servers, and cloud platforms by retaining the low latency and high bandwidth characteristics of traditional NVMe. This makes it suitable for applications that demand ultra-fast storage access, such as databases, analytics, and content delivery, and it simplifies the infrastructure due to its compatibility with traditional network technology investments. These benefits will help clients adopt a software-defined approach designed to deliver a cloud-like experience in terms of speed, agility, and economics.

NVMe/TCP can help Ceph bridge the gap for traditional block storage with scale-out architectures. With NVMe/TCP, Ceph will be designed to integrate with platforms like VMware to help enterprises replicate cloud architectures in their own data center, moving away from expensive and rigid SAN networks and monolithic storage arrays. 

Additional new features included in Ceph 7.0:

  • SEC and FINRA compliancy certification for WORM with object lock, enabling WORM compliance for object storage
  • NFS support for CephFS filesystem access for non-native Ceph clients
  • For more details on features, visit the IBM Storage community here

Cloud Economies of Scale with IBM Storage Ceph

Because IBM Storage Ceph stores data as objects within logical storage pools, a single cluster can have multiple pools, each tuned to different performance or capacity requirements. This allows clients to benefit from easier and faster access to data with content and context classifications, storage capacity limited only by the size of an organization’s infrastructure, and cost reductions at scale by removing hardware restrictions compared to traditional and legacy storage array architectures.

Read More  IBM Brings Watsonx To ESPN Fantasy Football With New Waiver Grades And Trade Grades

Faster Time to Value

IBM has also made deployment for Ceph easier than ever before. With IBM Storage Ready Nodes for Ceph, the platform can be deployed as a complete software and hardware solution and comes in a variety of different capacity configurations optimized for running IBM Storage Ceph workloads. We’ve taken all the guesswork out of configuration, making it easier to digest, configure, and administer.

The growth of IBM Storage Ceph is just another example of how IBM’s storage hardware and software portfolio helps provide faster time to value with scaled capacity and performance to optimize costs for clients.

Source: cyberpogo.com


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Our humans need coffee too! Your support is highly appreciated, thank you!

Dean Marc

Part of the more nomadic tribe of humanity, Dean believes a boat anchored ashore, while safe, is a tragedy, as this denies the boat its purpose. Dean normally works as a strategist, advisor, operator, mentor, coder, and janitor for several technology companies, open-source communities, and startups. Otherwise, he's on a hunt for some good bean or leaf to enjoy a good read on some newly (re)discovered city or walking roads less taken with his little one.

Related Topics
  • Generative AI
  • IBM
  • IBM Storage
  • Red Hat
  • Storage Ceph
You May Also Like
Getting things done makes her feel amazing
View Post
  • Computing
  • Data
  • Featured
  • Learning
  • Tech
  • Technology

Nurturing Minds in the Digital Revolution

  • April 25, 2025
View Post
  • Data
  • Engineering

Hiding in Plain Site: Attackers Sneaking Malware into Images on Websites

  • January 16, 2025
IBM and Ferrari Premium Partner
View Post
  • Data
  • Engineering

IBM Selected as Official Fan Engagement and Data Analytics Partner for Scuderia Ferrari HP

  • November 7, 2024
dotlah-smartnation-singapore-lawrence-wong
View Post
  • Data
  • Enterprise
  • Technology

Growth, community and trust the ‘building blocks’ as Singapore refreshes Smart Nation strategies: PM Wong

  • October 8, 2024
nobel-prize-popular-physics-prize-2024-figure1
View Post
  • Data
  • Featured
  • Technology

They Used Physics To Find Patterns In Information

  • October 8, 2024
View Post
  • Cloud-Native
  • Multi-Cloud

Oracle Expands Multicloud Capabilities with AWS, Google Cloud, and Microsoft Azure

  • September 11, 2024
Cloud computing concept image double exposure Digitally Enhanced Smart City Concept with Cloud Computing
View Post
  • Cloud-Native
  • Computing
  • Hybrid Cloud
  • Multi-Cloud
  • Public Cloud

Make Your Business Resilient By Integrating These Best Practices Into Your Cloud Architecture

  • July 29, 2024
goswifties_number-crunching_202405_wm
View Post
  • Data
  • Featured

Of Nuggets And Tenders. To Know Or Not To Know, Is Not The Question. How To Become, Is.

  • May 25, 2024

Stay Connected!
LATEST
  • 1
    Just make it scale: An Aurora DSQL story
    • May 29, 2025
  • 2
    Reliance on US tech providers is making IT leaders skittish
    • May 28, 2025
  • Examine the 4 types of edge computing, with examples
    • May 28, 2025
  • AI and private cloud: 2 lessons from Dell Tech World 2025
    • May 28, 2025
  • 5
    TD Synnex named as UK distributor for Cohesity
    • May 28, 2025
  • Weigh these 6 enterprise advantages of storage as a service
    • May 28, 2025
  • 7
    Broadcom’s ‘harsh’ VMware contracts are costing customers up to 1,500% more
    • May 28, 2025
  • 8
    Pulsant targets partner diversity with new IaaS solution
    • May 23, 2025
  • 9
    Growing AI workloads are causing hybrid cloud headaches
    • May 23, 2025
  • Gemma 3n 10
    Announcing Gemma 3n preview: powerful, efficient, mobile-first AI
    • May 22, 2025
about
Hello World!

We are aster.cloud. We’re created by programmers for programmers.

Our site aims to provide guides, programming tips, reviews, and interesting materials for tech people and those who want to learn in general.

We would like to hear from you.

If you have any feedback, enquiries, or sponsorship request, kindly reach out to us at:

[email protected]
Most Popular
  • 1
    Cloud adoption isn’t all it’s cut out to be as enterprises report growing dissatisfaction
    • May 15, 2025
  • 2
    Hybrid cloud is complicated – Red Hat’s new AI assistant wants to solve that
    • May 20, 2025
  • 3
    Google is getting serious on cloud sovereignty
    • May 22, 2025
  • oracle-ibm 4
    Google Cloud and Philips Collaborate to Drive Consumer Marketing Innovation and Transform Digital Asset Management with AI
    • May 20, 2025
  • notta-ai-header 5
    Notta vs Fireflies: Which AI Transcription Tool Deserves Your Attention in 2025?
    • May 16, 2025
  • /
  • Technology
  • Tools
  • About
  • Contact Us

Input your search keywords and press Enter.