Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale (2024)

IBM Storage Ceph, formerly Red Hat Ceph, has been on a mission to simplify the deployment and management of its software-defined storage (SDS) platform.

What once was hard has become easy. Since IBM announced the integration of Red Hat storage products into IBM Storage, there has been a surge in interest and growth as customers adopt cloud-native architectures. Those customers are realizing the public cloud’s cost, speed, and elasticity benefits. As such, IBM Storage Ceph, formerly Red Hat Ceph, has been on a mission to simplify the deployment and management of its software-defined storage (SDS) platform. The flexibility and scalability also make IBM Storage Ceph the ideal solution for handling generative AI use cases.

Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale (1)

IBM Storage Ceph provides an open, scalable, and software-defined multiprotocol storage solution designed to consolidate data anywhere and everywhere. Optimized for large single and multisite deployments, IBM Storage Ceph efficiently scales to support hundreds of petabytes of data and, in published tests, can support tens of billions of objects. This type of scale and inherent resiliency and security are key for supporting data lakehouses and AI/ML open-source frameworks.

Self-healing, Self-managing Platform

The flexibility of IBM Storage Ceph is apparent in management simplicity and enhanced agility in adjusting to growing business needs while scaling compute and capacity as new workloads are introduced. The self-healing, self-managing elements of the platform are designed to deliver unified file, block, and object storage services running on industry-standard hardware. The unified storage provides clients a bridge from legacy applications running on independent file or block storage to a common platform with object storage in a single appliance.

Support for data lakehouse and AI/ML, along with traditional workloads like MySQL and MongoDB on Red Hat OpenShift or Red Hat OpenStack, is a primary reason 768 TiB raw capacity of IBM Storage Ceph is included with watsonx.data, IBM’s open, governed, fit-for-purpose data lakehouse architecture.

A Solution To Address Continued Data Growth

The explosive growth of unstructured data and generative AI, a trend unlikely to abate anytime soon, influence and benefit each other. Gartner’s Top Trends in Enterprise Data Storage 2023 report suggests that “by 2028, large enterprises will triple their unstructured data capacity across their on-premises, edge, and public cloud locations compared to mid-2023.”

The growth of unstructured data like text, images, and videos fuels generative AI, helping it make sense of this data and find valuable insights. This creates a loop: AI improves with more data, and its realistic data generation enhances our understanding of unstructured datasets, leading to more innovation.

The same Gartner report predicts that “by 2028, 70 percent of file and object data will be deployed on consolidated unstructured data storage platform(s), up from 35 percent in early 2023.” As such, organizations will require a storage management solution that speeds up data handling – from ingestion and cleaning to classification and metadata management – and offers cloud-scale capacity management and deployment, all of which are available in a software-defined storage solution. The scale-out qualities of IBM Storage Ceph can seamlessly meet these growing data demands.

To accelerate and scale the impact of data and AI across an organization, IBM believes that companies need to implement a hybrid design. This will ultimately improve business outcomes. IBM Storage Ceph offers on-prem storage with a cloud-like model, addressing problems like the absence of enterprise features in public clouds, data sovereignty, and costs. Its easy-to-integrate architecture works with various platforms, clouds, hypervisors, open-source databases like Apache Iceberg and Parquet, and full stacks like watsonx.ai, watsonx.data. You can add new nodes or devices easily without interrupting service. It is an excellent choice for constructing a data lakehouse using watsonx.data and other AI workloads.

IBM Storage Ceph 7.0 Prepares for NVMe/TCP

IBM has been busy during 2023, introducing essential updates to Ceph, including IBM Storage Ceph 7.0. This next-generation Ceph platform prepares for NVMe/TCP capabilities designed to deliver faster data transfer between storage devices, servers, and cloud platforms while maintaining the low-latency and high-bandwidth characteristics of traditional NVMe.

IBM Storage Ceph is perfect for applications requiring high-speed storage, like databases, analytics, and content delivery. The architecture makes it easy to fit into current network environments, helping customers easily shift to a software-defined model for faster, more agile, and cost-effective operations.

NVMe/TCP lets Ceph enhance traditional block storage with scalable designs. With NVMe/TCP, Ceph can work with platforms like VMware, allowing businesses to mimic cloud setups in their data centers. This move can reduce reliance on costly, inflexible SAN networks and large storage arrays.

Other features in Ceph 7.0 include:

  • SEC and FINRA compliance certification for WORM with object lock, enabling WORM compliance for object storage
  • NFS support for CephFS filesystem access for non-native Ceph clients

For more details on features, visit the IBM Storage community.

No More Hardware Restrictions

IBM Storage Ceph stores data as objects within logical storage pools, allowing a single cluster to have multiple pools, each tuned to different performance or capacity requirements. Customers benefit from easier and faster data access with content and context classifications, storage capacity limited only by the size of the infrastructure, and cost reductions at scale by removing hardware restrictions compared to traditional and legacy storage array architectures.

Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale (2)

Ceph deployment has been made easier with IBM Storage Ready Nodes. This means the platform can be deployed as a complete software and hardware solution. Ready Nodes are available in various capacity configurations optimized for IBM Storage Ceph workloads.

Real World Adventure

Ceph.io takes you through some troubleshooting techniques when migrating from HDD to NVMe. Clyso was approached by a fairly hip and cutting-edge company that wanted to transition its HDD-backed Ceph cluster to a 10-petabyte NVMe deployment. Check out all the details from Ceph.io.

Engage with StorageReview

Newsletter|YouTube| PodcastiTunes/Spotify|Instagram|Twitter|TikTok|RSS Feed

    Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale (3)

    Harold Fritts

    I have been in the tech industry since IBM created Selectric. My background, though, is writing. So I decided to get out of the pre-sales biz and return to my roots, doing a bit of writing but still being involved in technology.

    Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale (2024)

    FAQs

    Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale? ›

    Simplified IBM Storage Ceph 7.0 Delivers Unified File, Block, and Object Storage At Scale. IBM Storage Ceph, formerly Red Hat Ceph, has been on a mission to simplify the deployment and management of its software-defined storage

    software-defined storage
    Software-defined storage (SDS) is a marketing term for computer data storage software for policy-based provisioning and management of data storage independent of the underlying hardware.
    https://en.wikipedia.org › wiki › Software-defined_storage
    (SDS) platform. What once was hard has become easy.

    Is ceph block storage or object storage? ›

    Ceph is an open source software-defined storage solution designed to address the block, file and object storage needs of modern enterprises. Its highly scalable architecture sees it being adopted as the new norm for high-growth block storage, object stores, and data lakes.

    What is IBM CEPH storage? ›

    IBM Storage Ceph is a scalable, open, software-defined storage platform that combines an enterprise-hardened version of the Ceph storage system, with a Ceph management platform, deployment utilities, and support services.

    What is the difference between IBM file storage and object storage? ›

    Management ease: The metadata and searchability make object storage a top choice for high volumes of data. File storage, with its hierarchical organization system, is more appropriate for lower volumes of data. Volume: Organizations with high volumes of data often choose object or block storage.

    How does ceph storage work? ›

    Within the Ceph Storage Cluster, the Ceph object storage devices stores the data as objects on storage nodes. A Ceph Storage Cluster can have thousands of storage nodes. Within the storage system itself, Ceph uses distributed object storage, which is a computer data storage architecture that treats data as objects.

    What are the disadvantages of Ceph storage? ›

    The complexity of Ceph's architecture can be a significant barrier, especially for organizations without the necessary technical expertise. Setting up and managing a Ceph cluster requires a deep understanding of its components and their interactions. Another potential downside is the initial setup and migration cost.

    Which is better object storage or block storage? ›

    Object storage works best for large volumes of unstructured data, while block storage is optimized for smaller amounts of data that are accessed often.

    Is Ceph still used? ›

    Within today's open source storage solutions area, Ceph is a very well known software-defined storage solution, widely being used as standalone storage solution, but also within forms of combined solutions alongside with other products and/or solutions.

    Is Ceph a database? ›

    Ceph OSDs control read, write, and replication operations on storage drives. The default BlueStore back end stores objects in a monolithic, database-like fashion. Ceph OSD Daemons store data as objects in a flat namespace. This means that objects are not stored in a hierarchy of directories.

    How much does Ceph cost? ›

    $13899 per calendar year for an accredited school of public health sponsored by more than one university. $4654 per calendar year for an accredited public health program with one degree level (master's OR baccalaureate).

    When not to use object storage? ›

    While object storage eliminates the need for directories, folders, and other complex hierarchical organization, it's not a good solution for dynamic data that is changing constantly as you'll need to rewrite the entire object to modify it.

    Why is object storage more scalable than file storage? ›

    File storage is structured in a hierarchical system with directories and subdirectories, requiring a specific path to locate each file. In contrast, object storage uses a flat address space where each piece of data, or 'object,' is stored with a unique identifier, allowing for more flexible and scalable data retrieval.

    What is an example of block storage? ›

    The most common examples of Block Storage are SAN, iSCSI, and local disks. Block storage is the most commonly used storage type for most applications. It can be either locally or network-attached and are typically formatted with a file system like FAT32, NTFS, EXT3, and EXT4.

    What are the advantages of Ceph storage? ›

    It also isn't dependent on expensive, specialized hardware and can be installed on commodity hardware. Among Ceph's other benefits are scalability and flexibility. Ceph provides multiple interfaces -- object, block and file -- for storage access, and you increase system capacity by adding more servers.

    Is Ceph an object store? ›

    Ceph is an open-source, software-defined platform employing a distributed object storage architecture designed for scalability, flexibility, and fault tolerance on commodity infrastructure.

    Is S3 object storage or block storage? ›

    Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance.

    What type of filesystem is Ceph? ›

    The Ceph File System (CephFS) is a file system compatible with POSIX standards that uses a Ceph Storage Cluster to store its data. The Ceph File System uses the same Ceph Storage Cluster system as the Ceph Block Device, Ceph Object Gateway, or librados API.

    What are examples of block storage? ›

    Storage layer consists of physical block storage devices like magnetic tape, disk drives, or optical media. Fabric layer bridges SAN servers and SAN storage with devices like SAN switches, protocol bridges, routers, cables, and gateway devices.

    Which storage type provides block level storage? ›

    Block level storage, or block storage, is storage used for structured data and is commonly deployed in Storage Area Network (SAN) systems. It uses Internet Small Computer Systems Interface (iSCSI) and Fibre Channel (FC) protocols.

    Top Articles
    Latest Posts
    Article information

    Author: The Hon. Margery Christiansen

    Last Updated:

    Views: 5910

    Rating: 5 / 5 (70 voted)

    Reviews: 93% of readers found this page helpful

    Author information

    Name: The Hon. Margery Christiansen

    Birthday: 2000-07-07

    Address: 5050 Breitenberg Knoll, New Robert, MI 45409

    Phone: +2556892639372

    Job: Investor Mining Engineer

    Hobby: Sketching, Cosplaying, Glassblowing, Genealogy, Crocheting, Archery, Skateboarding

    Introduction: My name is The Hon. Margery Christiansen, I am a bright, adorable, precious, inexpensive, gorgeous, comfortable, happy person who loves writing and wants to share my knowledge and understanding with you.