Magnesium Technologies, Inc. announced the first open source, heterogeneous memory storage engine (HSE) designed specifically for solid-state drives (SSDs) and storage-level memory (SCM).
Legacy storage engines born in the hard disk drive (HDD) era could not be architected to deliver the higher performance and shorter latency of next-generation non-volatile media. originally developed by magnesium and now available to the open source community, HSE is ideal for developers using all-flash infrastructure who need the benefits of open source software, including the ability to customize for their unique use cases or the ability to enhance code.
Derek Dicker, corporate vice president and general manager of the Storage Business Unit at Magnesium, said “We are providing open source storage developers with first-of-its-kind innovations that unlock the full potential of high-performance storage applications.”
In addition to delivering performance and endurance improvements, HSE reduces latency through intelligent data placement, especially for large data sets. HSE increases throughput by six times for specific storage applications, reduces latency by 11 times1 and increases SSD lifetime by seven times. HSE can also leverage multiple classes of media simultaneously, such as flash memory and 3D XPoint technology. Adding the world’s fastest SSD, the Micron X100 NVMe SSD, to a group of four Micron 5210 QLC SSDs more than doubled throughput and increased read latency by nearly four times.
Stefanie Chiras, vice president and general manager of Red Hat Enterprise Linux, said, “We see tremendous potential in the technology introduced by Magnesium, especially because it takes an innovative approach to reducing latency between compute, memory and storage resources.” . “We look forward to working further with Magnesium in the open source community to further develop these innovations and ultimately bring new options to the storage space based on open standards and concepts.”
“As the demand for object-based storage continues to grow and it is deployed into more and more workloads, it is no surprise that our customers are increasingly interested in fast object storage,” said Brad King, chief technology officer and co-founder of Scality. “While our storage software can support “cheap and deep” on the lowest cost commercial hardware for the simplest workloads, it can also leverage technologies such as flash, storage class memory and SSDs to meet the performance benefits of very demanding workloads. Magnesium’s HSE technology enhances our ability to continue to optimize flash performance, latency and SSD endurance without the trade-offs.”
Features and benefits of heterogeneous memory storage engines:
Integration with MongoDB, the world’s most popular NoSQL database, dramatically improves performance, reduces latency and leverages modern memory and storage technologies. It can also integrate with other storage applications such as NoSQL databases and object repositories.
HSE is ideal when large-scale performance is critical, including very large data sizes, large key counts (billions), high operational concurrency (thousands) or deployment of multiple media.
The platform is designed to scale to new interfaces and new storage devices and can be used with a variety of applications and solutions including databases, Internet of Things (IoT), 5G, Artificial Intelligence (AI), High Performance Computing (HPC) and object storage.
HSE can provide additional performance for software-defined storage, such as Red Hat Ceph Storage and Scality RING, which can support cloud-native applications through container platforms such as Red Hat OpenShift, as well as tiered performance for file, block and object storage protocols. Multiple use cases.
HSE is offered as an embeddable key-value database; Micron will maintain the code repository on GitHub.
Post time: Apr-10-2023
