Digital storage technology saved the world from a rogue AI in the latest Mission Impossible Movie. Combining SSDs and HDDs enable AI workload cost and performance.
In this article we will look at some resent announcerments on digital storage and its use in AI training and inference. But first, an example of digital storage technology used to save humanity.Digital archiving startup SPhotonix’s 5D memory crystal was an important element in the plot of the latest Mission Impossible movie.
The 360TB memory crystal was used to stop a rogue AI from destroying the world. In practice, SPhotonix stores data using a FemtoEtch nano-etching technology on a 5-inch glass substrate. Note that I am an advisor for SPhotonix.Digital storage technologies have been used in many movies and TV shows over the years, such as the StorageTek Tape library used in the 1994 Film “Clear and Present Danger.”In practice data centers are generally using SSDs as primary storage in data centers, including for AI training applications. SSDs provide fast storage for refreshing data on the high bandwidth memory located close to the GPUs that directly support data processing. However, the cost for storing data on SSDs in data centers is about 6X higher than storing it on HDDs. Bitcoin ‘Going To Take Over’—Tesla CEO Elon Musk Backs Shock $40 Trillion U.S. Dollar Collapse Warning Amid Price BoomTrump’s Bedminster Golf Club Flagged For 18 Health Violations In Latest Inspection—Earned Lowest Grade In County This leads data centers to use HDDs for storing colder but useful data in a hierarchical storage environment. Data is moved back and forth from various storage technologies to optimize the balance of cost versus performance. Ultimately archived information in data centers that is not frequently used is kept on magnetic tape cartridges or optical storage.and announced changes in their hybrid SSD and HDD storage offering to support HPC and AI workloads. The company is now offering QLC NAND flash SSDs combined with high-capacity HDDs with their global namespace parallel file system combined with object storage, offering multi-level erasure coding and fast key value storage. The image below shows the layout of this hybrid SSD and HDD storage system.The Vdura Data Platform V11.2 includes a preview of V-ScaleFlow that enables data movement across QLC flash and high-capacity hard drives. This allows resource utilization, maximizes system throughput and provides efficient AI-scale workloads. In particular the company is using Phison Pascari 128TB QLC NVMe SSD with 30+TB HDDs to reduce flash capacity requirements by over 50% and lowing power consumption. Overall total cost of ownership is said to be reduced by up to 60%. The Vdura white paper goes into details on data storage and memory utilization in an AI application. The figure below shows an AI data pipeline which should have the storage system enable minimum GPU downtime.The table below goes into detail on read, write, performance and data size requirements for various elements in an AI workload. These various elements can require from GBs to PBs of digital storage with various performance requirements. This favors a combination of storage technologies to support different elements in this workload.The below image shows a sample storage node that can provide all-flash or hybrid SSD and HDD storage to support AI and HPC workloads with a global namespace and a common control and data plane.Digital storage technology saved the world from a rogue AI in the latest Mission Impossible Movie. Combining SSDs and HDDs can enable modern AI workloads that optimize cost and performance.
Sphotonix Vdura AI Digital Storage Memory 5D Memory Crystal Global Namespace
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
More than 60 firefighters respond to storage facility fire in Everett, WAMore than 60 firefighters responded to a fire at a storage facility in Everett on Monday evening.
Read more »
Nutanix And Pure Storage Collaborate To Answer VMware UncertaintyNutanix and Pure Storage partner to offer an integrated solution for virtualization as VMware customers seek alternatives under Broadcom ownership.
Read more »
Nvidia Dynamo And Storage Next Boost AI Storage, Performance And Lowers CostsNvidia’s Dynamo enables faster and more efficient AI inference with scalable digital storage and memory hierarchical KV caching. More to come.
Read more »
Take a tour with SRP to see the reality of Arizona's water storageFOX 10's John Hook got a bird's eye view of several lakes and dams in Arizona that store much of the state's water. We're checking out how full the lakes and dams are, and if they align with the idea that Arizona is in a water crisis.
Read more »
Germany’s underwater energy vaults could be the world’s next power storage giantFraunhofer’s ocean spheres store renewable energy using deep-sea pressure—enough to power millions of homes annually.
Read more »
Digital twin exposes hidden battery blind spot in energy storage systemsA digital twin helped operators of a Dutch battery energy storage system detect a hidden 4 percent degradation.
Read more »